Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Unreleased

3.0.1 - 2022-07-23

Changed

  • Updated dependencies and MSRVs to fix builds. (#47 et. al.)

3.0.0 - 2022-06-01

Added

  • Language support for Arabic (#40).
  • Add the Language trait to make it easier to implement languages outside the crate.
  • Add IndexBuilder::add_field_with_tokenizer to specify the tokenizer for a field.

Changed

  • Update to 2018 edition, and bump MSRV to 1.54.0.
  • Change benchmarks to use Criterion.
  • Remove dependency on lazy_static.
  • Update dependencies.
  • Use Unicode character classes for trimmer.
  • IndexBuilder functions which add fields will now panic if the same field is added multiple times.
  • Fix IndexBuilder not respecting field insertion order.

Removed

  • Remove the default feature. You now need to opt-in to the languages feature.
  • Remove the deprecated function Pipeline::for_language.
  • Remove the pipeline::tokenize* functions, which are now implemented as part of the Language trait.
  • Remove Index::add_doc_with_tokenizer(s), replaced by IndexBuilder::add_field_with_tokenizer.
  • Remove the Language enum. Use the Language trait implementations in the lang modules, and the free functions lang::from_name, lang::from_code, and lang::languages.