Release note for v0.5.0

[heronshoes]

RedAmber v0.5.0 has released 🎉

This release contains upgrading dependency to Arrow 12.0.0 .
Topics for this release is below;

Topics

• Supported Arrow 12.0.0
• Refined Group and Subframes
• Refined Join to use Acero
• Introduced MatchStringOptions family methods
• Rank has supported tiebreakers
• Index has switched to use compute kernel

Stats from 0.4.2 to 0.5.0

• 40 files changed, 1786 insertions(+), 395 deletions(-)

• 519 tests, 1424 assertions (0.2.3) =>
  605 tests, 1651 assertions (0.3.0) =>
  721 tests, 1897 assertions (0.4.0) =>
  799 tests, 2081 assertions (0.4.1) =>
  810 tests, 2106 assertions (0.4.2) =>
  861 tests, 2167 assertions (0.5.0)

• 100% Test coverage

• 100% Document coverage

Changelog of this release is below. Your help is welcome!

[0.5.0] - 2023-05-24

• Breaking change

  • Use non keyword argument in #sub_by_value (Refine group #219)
  • Upgrade dependency to Arrow 12.0.0 (Upgrade to Arrow 12.0.0 and update DataFrame#join #238)
    • right_join will output columns as same order as Red Arrow.
    • DataFrame#join will not force ordering of original column by default
    • Join with type, such as full_join, sort after join by default

• Bug fixes

  • Use truncate in Vector#sample(float) (Use truncate in Vector#sample(float) #229)
  • Support options in DataFrame#tdra (Support options in DataFrame#tdra #231)
  • Fix printing table with non-ascii strings (Fix printing table with non-ascii strings #233)
  • Fix join for Arrow 12.0.0

• New features and improvements

  • Add a singleton method Vector.[] (Add vector singleton method #218)
  • Add an alias #sub_group (Refine group #219)
  • Accept Group#summarize{Hash} to rename aggregated columns (Refine group #219)
  • Add Group#group_frame (Refine group #219)
  • Add Vector#cast (Add Vector#cast #224)
  • Add Vector#fill_nil(value) (Add Vector#fill_nil(value) #226)
  • Add Vector#one (Add Vector#one #227)
  • Add Vector#mode (Add Vector#mode #228)
  • Add DataFrame#propagate (Add DataFrame#propagate #235)
  • Add DataFrame#sample (Add dataframe sample #237)
  • Add DataFrame#shuffle (Add dataframe sample #237)
  • Support RankOptions in Vector#rank (Update rank method #239)
  • Introduce MatchSubstringOptions family in Vector (Introduce Vector#match_substring? #241)
    • Introduce Vector#match_substring?
    • Add Vector#end_with?, #start_with? method
    • Add Vector#match_like?
    • Add Vector#count_substring method

• Refactoring

  • Refine Group and SubFrames function (Refine group #219)
    • Refine Group#group_count
    • Use Acero in Group#filters
    • Refine Group#filters, not using Acero
    • Refine Group#summarize(array)
  • Use Acero for renaming columns in join (Upgrade to Arrow 12.0.0 and update DataFrame#join #238)
  • Use index kernel with IndexOptions introduced in 12.0.0 (Update Vector#index method #240)

• Improve in tests/CI

  • Use Fedra 39 Rawhide in CI (Upgrade to Arrow 12.0.0 and update DataFrame#join #238)

• Documentation and Example

  • Add missing yard documents for SubFrames::Selectors (Refine group #219)
  • Update docker/example (Refine group #219)
  • Update Gemfile in docker (Refine group #219)
  • Add README.ja.md (Add README.ja.md #242)

• GitHub site

  • Update link of Red Data Tools Chat to matrix (Add README.ja.md #242)

• Thanks