The main new feature of Thinc v9 is the support for learning rate schedules that can take the training dynamics into account. For example, the new plateau.v1 schedule scales the learning rate when no progress has been found after a given number of evaluation steps. Another visible change is that AppleOps is now part of Thinc, so it is not necessary anymore to install thinc-apple-ops to use the AMX units on Apple Silicon.
✨ New features and improvements
Learning rate schedules can now take the training step as well as an arbitrary set of keyword arguments. This makes it possible to pass information such a the parameter name and last evaluation score to determine the learning rate (#804).
Added the plateau.v1 schedule (#842). This schedule scales the learning rate if training was found to be stagnant for a given period.
The functionality of thinc-apple-ops is integrated into Thinc (#927). Starting with this version of Thinc, it is not necessary anymore to install thinc-apple-ops.
Schedules are not generators anymore, but implementations of the Schedule class (#804).
thinc.backends.linalg has been removed (#742). The same functionality is provided by implementations in BLAS that are better tested and more performant.
thinc.extra.search has been removed (#743). The beam search functionality in this module was strongly coupled to the spaCy transition parser and has therefore moved to spaCy in v4.
📅Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕Ignore: Close this PR and you won't be reminded about this update again.
If you want to rebase/retry this PR, check this box
This PR has been generated by Mend Renovate. View repository job log here.
[](https://renovatebot.com)
This PR contains the following updates:
| Package | Change | Age | Adoption | Passing | Confidence |
|---|---|---|---|---|---|
| [thinc](https://togithub.com/explosion/thinc) | `==8.2.3` -> `==9.0.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) |
---
### Release Notes
<details>
<summary>explosion/thinc (thinc)</summary>
### [`v9.0.0`](https://togithub.com/explosion/thinc/releases/tag/v9.0.0): : better learning rate schedules, integration of thinc-apple-ops
[Compare Source](https://togithub.com/explosion/thinc/compare/v8.2.3...v9.0.0)
> The main new feature of Thinc v9 is the support for [learning rate schedules](https://thinc.ai/docs/api-schedules#schedule) that can take the training dynamics into account. For example, the new [`plateau.v1`](https://thinc.ai/docs/api-schedules#plateau) schedule scales the learning rate when no progress has been found after a given number of evaluation steps. Another visible change is that [`AppleOps`](https://thinc.ai/docs/api-backends) is now part of Thinc, so it is not necessary anymore to install [`thinc-apple-ops`](https://togithub.com/explosion/thinc-apple-ops) to use the AMX units on Apple Silicon.
#### ✨ New features and improvements
- [Learning rate schedules](https://thinc.ai/docs/api-schedules#schedule) can now take the training step as well as an arbitrary set of keyword arguments. This makes it possible to pass information such a the parameter name and last evaluation score to determine the learning rate ([#​804](https://togithub.com/explosion/thinc/issues/804)).
- Added the [`plateau.v1`](https://thinc.ai/docs/api-schedules#plateau) schedule ([#​842](https://togithub.com/explosion/thinc/issues/842)). This schedule scales the learning rate if training was found to be stagnant for a given period.
- The functionality of [`thinc-apple-ops`](https://togithub.com/explosion/thinc-apple-ops) is integrated into Thinc ([#​927](https://togithub.com/explosion/thinc/issues/927)). Starting with this version of Thinc, it is not necessary anymore to install `thinc-apple-ops`.
#### 🔴 Bug fixes
- Fix the use of thread-local storage ([#​917](https://togithub.com/explosion/thinc/commit/5c46b82a47781ebff91c953c42c2361a3cdd4f15)).
#### ⚠️ Backwards incompatibilities
- Thinc v9.0.0 only support Python 3.9 and later.
- Schedules are not generators anymore, but implementations of the [`Schedule`](https://thinc.ai/docs/api-schedules#schedule) class ([#​804](https://togithub.com/explosion/thinc/issues/804)).
- `thinc.backends.linalg` has been removed ([#​742](https://togithub.com/explosion/thinc/issues/742)). The same functionality is provided by implementations in BLAS that are better tested and more performant.
- `thinc.extra.search` has been removed ([#​743](https://togithub.com/explosion/thinc/issues/743)). The beam search functionality in this module was strongly coupled to the spaCy transition parser and has therefore [moved to spaCy](https://togithub.com/explosion/spaCy/pull/11317) in v4.
#### 👥 Contributors
[@​adrianeboyd](https://togithub.com/adrianeboyd), [@​danieldk](https://togithub.com/danieldk), [@​honnibal](https://togithub.com/honnibal), [@​ines](https://togithub.com/ines), [@​kadarakos](https://togithub.com/kadarakos), [@​shadeMe](https://togithub.com/shadeMe), [@​svlandeg](https://togithub.com/svlandeg)
</details>
---
### Configuration
📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 **Ignore**: Close this PR and you won't be reminded about this update again.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box
---
This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://developer.mend.io/github/SphericalKat/deezbot).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4zNjguMTAiLCJ1cGRhdGVkSW5WZXIiOiIzNy4zNjguMTAiLCJ0YXJnZXRCcmFuY2giOiJtYWluIiwibGFiZWxzIjpbXX0=-->
You are not authorized to merge this pull request.
This pull request can be merged automatically.
View command line instructions
Checkout
From your project repository, check out a new branch and test the changes.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
This PR contains the following updates:
==8.2.3->==9.0.0Release Notes
explosion/thinc (thinc)
v9.0.0: : better learning rate schedules, integration of thinc-apple-opsCompare Source
✨ New features and improvements
plateau.v1schedule (#842). This schedule scales the learning rate if training was found to be stagnant for a given period.thinc-apple-opsis integrated into Thinc (#927). Starting with this version of Thinc, it is not necessary anymore to installthinc-apple-ops.🔴 Bug fixes
⚠️ Backwards incompatibilities
Scheduleclass (#804).thinc.backends.linalghas been removed (#742). The same functionality is provided by implementations in BLAS that are better tested and more performant.thinc.extra.searchhas been removed (#743). The beam search functionality in this module was strongly coupled to the spaCy transition parser and has therefore moved to spaCy in v4.👥 Contributors
@adrianeboyd, @danieldk, @honnibal, @ines, @kadarakos, @shadeMe, @svlandeg
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by Mend Renovate. View repository job log here.
View command line instructions
Checkout
From your project repository, check out a new branch and test the changes.