Commit Graph

142 Commits

Author SHA1 Message Date
Dirkjan Ochtman 2ab57ca0b1 Fix typo 2020-12-07 14:36:59 +01:00
Dirkjan Ochtman c571996925 Simplify bigram scoring algorithm 2020-12-07 14:24:33 +01:00
Dirkjan Ochtman f26793379b No longer need a macro for testing 2020-12-07 11:55:27 +01:00
Dirkjan Ochtman 912e6477e3 Fix clippy problems in test data setup 2020-12-07 11:46:42 +01:00
Dirkjan Ochtman 4aaa661328 Bump version number to 0.3.0 2020-12-07 11:40:09 +01:00
Dirkjan Ochtman eeb9c77bc7 Simplify Segmenter setup API 2020-12-07 11:39:49 +01:00
Dirkjan Ochtman 4b7760ee41 Bump version number 2020-11-26 11:40:03 +01:00
Dirkjan Ochtman c11da266aa Update performance claim in README 2020-11-26 11:39:57 +01:00
Dirkjan Ochtman d554825594 Name complex type as suggested by clippy 2020-11-26 11:33:36 +01:00
Dirkjan Ochtman 691ecbc3c6 Simplify handling of empty tails 2020-11-26 11:20:06 +01:00
Dirkjan Ochtman ae3896b47b Use range for previous argument as well 2020-11-26 11:15:27 +01:00
Dirkjan Ochtman bc20e39c1e Make slicing cheaper by adding a little unsafe code 2020-11-26 11:14:53 +01:00
Dirkjan Ochtman bb1b1db9c5 Pass Range instead of str to search() 2020-11-26 11:13:35 +01:00
Dirkjan Ochtman 4be435e0fb Make split values absolute instead of relative 2020-11-26 11:12:52 +01:00
Dirkjan Ochtman b7daaff47a Simplify top-level loop 2020-11-26 10:46:27 +01:00
Dirkjan Ochtman 2f9cb95b5c Avoid allocations for split vectors 2020-11-26 10:46:23 +01:00
Dirkjan Ochtman 62bb7130b6 Switch to main as default branch 2020-11-25 22:31:27 +01:00
Dirkjan Ochtman bd497d155d Remove unnecessary closure wrapper 2020-11-25 22:30:14 +01:00
Dirkjan Ochtman ed8e13b10c Use all features for clippy, too 2020-11-25 22:24:08 +01:00
Dirkjan Ochtman 52dd5ec598 Allow MPL licenses 2020-11-25 17:34:03 +01:00
Dirkjan Ochtman a1f03e32fe Remove unused lifetime 2020-11-25 17:33:50 +01:00
Dirkjan Ochtman 2164044eb1 Build with all features enabled 2020-11-25 17:31:35 +01:00
Dirkjan Ochtman 47271ff81e Allocate a single Vec to back cached splits 2020-11-25 17:29:13 +01:00
Dirkjan Ochtman 947e003a48 Store splits instead of string slices 2020-11-25 17:29:13 +01:00
Dirkjan Ochtman 1df3c4397e Inline TextDivider iterator 2020-11-25 17:29:13 +01:00
Dirkjan Ochtman ead9a3064b Better typed handling of previous word 2020-11-25 17:29:13 +01:00
Dirkjan Ochtman ea4438f2e8 Make Segmenter::score() slightly more efficient 2020-11-25 17:29:13 +01:00
Dirkjan Ochtman 540348f703 Abstract over test data format code and API 2020-11-25 17:29:13 +01:00
Dirkjan Ochtman 54c6e64e21 Bump version number 2020-11-25 17:29:13 +01:00
Dirkjan Ochtman 0d7fbd53e7 Prevent allocations where possible 2020-11-25 17:29:11 +01:00
dependabot-preview[bot] 10afa21349 Update ahash requirement from 0.5.7 to 0.6.1
Updates the requirements on [ahash](https://github.com/tkaitchuck/ahash) to permit the latest version.
- [Release notes](https://github.com/tkaitchuck/ahash/releases)
- [Commits](https://github.com/tkaitchuck/ahash/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-11-25 09:56:19 +01:00
Dirkjan Ochtman 2b39f45547 Update GitHub Actions 2020-11-23 13:24:46 +01:00
Dirkjan Ochtman 1b4377715f Move from err-derive to thiserror 2020-11-23 13:23:16 +01:00
Dirkjan Ochtman e5e46d6c1b Upgrade to ahash 0.5.7 2020-11-23 13:21:54 +01:00
Dirkjan Ochtman 9c5f93644a Fill out more Cargo metadata 2020-11-23 13:20:55 +01:00
Dirkjan Ochtman 93bbff91ca Create initial README (fixes #1) 2020-06-19 13:14:27 +02:00
Dirkjan Ochtman 76bdcf1ca5 Separate state from Segmenter 2020-05-28 19:56:13 +02:00
Dirkjan Ochtman 98a8368be6 Avoid string allocations for search 2020-05-28 19:56:13 +02:00
Dirkjan Ochtman b9c8402b0c Prevent allocations for memo keys 2020-05-28 19:56:13 +02:00
Dirkjan Ochtman 0f69f267d8 Use ahash for hashing 2020-05-28 19:56:13 +02:00
Dirkjan Ochtman c11b30526d Add simple benchmark 2020-05-28 19:56:13 +02:00
Dirkjan Ochtman 38f9747c92 Initial version 2020-05-26 20:07:00 +02:00