Commit Graph

158 Commits

Author SHA1 Message Date
Dirkjan Ochtman e8753f1272 Switch CI from actions-rs/toolchain to dtolnay/rust-toolchain 2023-10-17 15:17:39 +02:00
Michael Partheil 05933eae07 Bump version to 0.11 2023-10-17 14:42:50 +02:00
Michael Partheil 647adb1694 Switch to `rustc_hash` instead of `ahash` 2023-10-17 14:42:50 +02:00
Michael Partheil 3b3627422b Use nested `HashMap` for storing both unigram and bigram scores 2023-10-17 14:42:50 +02:00
Michael Partheil 5810373471 Specify `rustc-version` to be 1.65 2023-10-17 14:42:50 +02:00
Michael Partheil 714b21aad5 Pre-compute unigram and bigram scores 2023-10-17 14:42:50 +02:00
Michael Partheil 5e232a3d6f Add a second benchmark 2023-10-17 14:42:50 +02:00
Dirkjan Ochtman ff32a353f8 Upgrade pyo3 to 0.20 2023-10-12 16:07:18 +02:00
dependabot[bot] a6180345bc Update pyo3 requirement from 0.18.0 to 0.19.0
Updates the requirements on [pyo3](https://github.com/pyo3/pyo3) to permit the latest version.
- [Release notes](https://github.com/pyo3/pyo3/releases)
- [Changelog](https://github.com/PyO3/pyo3/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pyo3/pyo3/compare/v0.18.0...v0.19.0)

---
updated-dependencies:
- dependency-name: pyo3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-05 17:53:42 +02:00
Dirkjan Ochtman c34f7d5515 Return empty iterator for empty string 2023-03-10 11:13:04 +01:00
Dirkjan Ochtman fbe7b9ad75 Apply clippy suggestions 2023-01-23 15:21:58 +01:00
dependabot[bot] 9d89c58b41 Update pyo3 requirement from 0.17.1 to 0.18.0
Updates the requirements on [pyo3](https://github.com/pyo3/pyo3) to permit the latest version.
- [Release notes](https://github.com/pyo3/pyo3/releases)
- [Changelog](https://github.com/PyO3/pyo3/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pyo3/pyo3/compare/v0.17.1...v0.18.0)

---
updated-dependencies:
- dependency-name: pyo3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-23 15:15:02 +01:00
Dirkjan Ochtman cb4ded8f51 Use string for Python 3.10 2022-09-13 12:19:43 +02:00
Dirkjan Ochtman f1ee97de0f Add Python 3.10 to publish workflow 2022-09-13 11:59:15 +02:00
Dirkjan Ochtman a5deae92ca Bump version for Python bindings to 0.1.5 2022-09-13 11:59:15 +02:00
Dirkjan Ochtman 3ff31ba21b Bump version number to 0.10.1 2022-09-08 11:39:32 +02:00
Antonio Schiavon 8c69bf577c
support numbers (#31) 2022-09-07 17:46:32 +02:00
Dirkjan Ochtman 0f776b8e6d Upgrade to PyO3 0.17 2022-08-29 11:36:05 -07:00
Dirkjan Ochtman 1e7bfbc3ce Ignore faulty clippy lint for now 2022-08-15 10:23:35 +02:00
Dirkjan Ochtman b68655c17d Remove authors from Cargo metadata (see RFC 3052) 2022-08-15 10:23:35 +02:00
Dirkjan Ochtman 22fff673e6 Bump version to 0.10 2022-08-15 10:23:35 +02:00
Dirkjan Ochtman c4864fe724 Upgrade ahash to 0.8 2022-08-15 10:23:35 +02:00
Dirkjan Ochtman 747dd22098 Add some minimal documentation 2022-02-28 11:38:50 +01:00
Dirkjan Ochtman 2ef7eb82ba Bump instant-segment version to 0.9 2022-02-28 11:38:34 +01:00
Dirkjan Ochtman eac10fb553 Apply clippy suggestion 2022-02-28 11:35:38 +01:00
Dirkjan Ochtman 3709223fa9 Update pyo3 to 0.16 2022-02-28 11:34:57 +01:00
Dirkjan Ochtman 77203fc78c Update smartstring to 1 2022-02-28 11:34:32 +01:00
Dirkjan Ochtman c911457226 Leverage simplified Python protocols 2021-11-10 09:41:31 +01:00
dependabot[bot] 2d97878ed7 Update pyo3 requirement from 0.14.1 to 0.15.0
Updates the requirements on [pyo3](https://github.com/pyo3/pyo3) to permit the latest version.
- [Release notes](https://github.com/pyo3/pyo3/releases)
- [Changelog](https://github.com/PyO3/pyo3/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pyo3/pyo3/compare/v0.14.1...v0.15.0)

---
updated-dependencies:
- dependency-name: pyo3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-11-10 09:40:14 +01:00
Dirkjan Ochtman 30a80c4a79 Add minimal pyproject.toml 2021-09-15 16:37:41 +02:00
Dirkjan Ochtman ef38bedaa2 Improve selection of Python versions 2021-09-01 16:11:13 +02:00
Dirkjan Ochtman 950faa6854 Tweak publish workflow 2021-08-31 16:42:39 +02:00
Dirkjan Ochtman 4c317051ef Publish platform wheels after tag push 2021-08-31 16:29:17 +02:00
Dirkjan Ochtman fb2a46ca27 Add Python test job 2021-08-31 16:29:17 +02:00
Dirkjan Ochtman bd12ef8b69 Fix up python test code 2021-08-31 16:29:17 +02:00
Dirkjan Ochtman 906f202611 Fix some more clippy suggestions 2021-08-31 14:19:36 +02:00
Dirkjan Ochtman e12390ea7d py: bump version number to 0.1.4 2021-08-31 14:16:33 +02:00
Dirkjan Ochtman 2babad4a58 Bump version to 0.8.3 2021-08-31 14:15:32 +02:00
Dirkjan Ochtman f32b42537a Update links to point to new GitHub org 2021-08-31 14:10:13 +02:00
Dirkjan Ochtman edfad13ddc Fix clippy lint 2021-08-31 14:09:23 +02:00
Beau Hartshorne f16306499c
Update README.md 2021-08-18 13:23:38 -07:00
Beau Hartshorne 8230ac6ed5
Update README.md 2021-08-18 13:18:56 -07:00
dependabot[bot] fdd743478e Update pyo3 requirement from 0.13.2 to 0.14.1
Updates the requirements on [pyo3](https://github.com/pyo3/pyo3) to permit the latest version.
- [Release notes](https://github.com/pyo3/pyo3/releases)
- [Changelog](https://github.com/PyO3/pyo3/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pyo3/pyo3/compare/v0.13.2...v0.14.1)

---
updated-dependencies:
- dependency-name: pyo3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-07-05 15:09:48 +02:00
Beau Hartshorne e2f6f5c4a5
Update README.md 2021-06-05 14:30:22 -07:00
Dirkjan Ochtman bc59c6cf6f Refactor to make test segmenter more accessible 2021-06-03 16:09:24 +02:00
Dirkjan Ochtman 65b85d9806 Remove old data files 2021-06-03 16:09:24 +02:00
Dirkjan Ochtman 99ddbf7366 Update data README 2021-06-03 16:09:24 +02:00
Dirkjan Ochtman 3c52201fa0 Update test cases to deal with new data 2021-06-03 16:09:24 +02:00
Dirkjan Ochtman fee2adb995 Add new data files 2021-06-03 16:09:24 +02:00
Dirkjan Ochtman fcf24c7543 Add Rust code to process ngram data 2021-06-03 16:09:24 +02:00