All notable changes between Rockpool releases will be documented in this file
- More detailed description about power measurement in XyloAudio 3.
- Add missing implementation for use of the second synapses in XyloAudio 3. Implementation was incomplete in the front-end.
- pkg_resources was removed from setuptools>=82, fix Rockpool code to not depend on it anymore. Now using packaging.
- Update jax.numpy.clip arguments (deprecated a_max, a_min) and uses max, min instead.
- jax.numpy.fix was deprecated in JAX v0.9.0, and will be removed in JAX v0.10.0. Using jax.numpy.trunc instead.
- Update setup.py file to match the minimum Python requirement for Rockpool: v3.10
- Fix JAX dependency for Xylo. Absence of JAX library was causing error when using AFESimExternal.
- Fix update of main clock frequency of XyloAudio 2. Now it also adjust SPI and SAER clocks that are dependent on the main clock.
- XyloMonitor for XyloAudio 2 now has an
auto_calibrateflag. The autocalibration is performed by default, so old behavior does not change.
- Fix bug on XyloIMU when changing the main clock frequency. Now, other internal clocks of XyloIMU are automatically updated to match constraints among clocks.
- Fix typo in documentation for XyloIMU
- Update documentation: now typehint from function descriptions appear also in parameter description automatically
- Fix bug on timestep count in real-time mode for XyloAudio 2
- Update documentaion: Add bibtex references for SynSense hardware that can be used with Rockpool
- Update documentation: fix typos and minor bugs on tutorials for XyloAudio 2 and XyloAudio 3
- Update documentation on Zenodo
- Fix bug that was generating NaN values in power measurement if XyloMonitor or XyloSamna classes were initialized in a loop.
- Update release instructions to add logo color information
- Update functions and methods to be compatible with Python 3l.12 and Numpy >= 2.0
- Update docker image for CI pipeline
- Improve precision of power measurement by start and stop power measurement in evolve call of XyloMonitor/XyloSamna
- Remove support for XyloTestBoard, XyloDevKit and XyloAudio 1, following updates on Samna 0.46.0. This breaks compatibility with old versions.
as_graphmethod ofahp_lifmodule changed to make it compatible with the mapper of XyloAudio 2
- Add missing audio samples for XyloAudio 3 tutorial
Using XyloSamna and XyloMonitor to deploy a model on XyloAudio 3 HDK
- Initialization of
XyloSamnaorXyloMonitorin a loop was crashing when recording power.
- Restrict max version for samna to prevent unexpected updates breaking Rockpool
- Audio Front End using PDM input data was not configured correctly for XyloAudio 3
- Power measurement for XyloAudio 3
- AFESamna module for XyloAudio 3: allow recording of input spikes from live microphone
- Complete set of tutorials for XyloAudio 3
- Remove dependence of imp module that was deprecated in Python 3.12
- Fixed bug in multiplying
TSContinuousobjects with differing numbers of channels
- Rockpool package was not generate on conda-forge. Update package build requirements.
- Support for Xylo™Audio 3 development kit
- Hardware interface via samna
- Digital microphone input and simulaton package
- Cycles model
- Simulation support for audio front-end:
AFESimExternal,AFESimAGC, andAFESimPDMwith all the necessary sub-modules
- Tutorial and documentation for the
SynNetarchitecture, to improve visibility
- Update
release notesfor developers in documentation- Add check for version
- Add check for copyright
- Update dependency version of Jax to >=0.4.28
- Move instructions to build documentation inside
Contributingsection
- Add cycles model for Xylo Audio and Xylo IMU, enabling users to calculate the required master clock frequency for Xylo
- Add support for NIR, for importing and exporting Rockpool torch networks
LIFExodusnow supports vectors as threshold parameter- Standard
LIFmodules now havew_recas a simulation parameter when in non-recurrent mode
TypeErrorwhen usingLIFExodus- Update
jax.configusage - Power measurement for
xyloA2was not considering AFE channels - Remove
check_gradsfrom Jax tests, since this will fail for LIF neurons due to surrograte gradients - Fix a bug in
AFESimon windows, where the maximum int32 value would be exceeded when seeding the AFE simulation - Fix stochasticity in some unit tests
- Fix a bug in
channel_quantize, where quantization would be incorrectly applied for Xylo IMU networks with Nien < Nhid - Fix a bug in
channel_quantize, where hidden unit biases would be incorrectly used in place of output unit biases - Fix a non-handled buffer bug in
LIFJax, where non-recurrent modules would sometimes have garbage inw_recinstead of all zeros - Fix a bug in
TorchSequential.as_graph(), where torch module functions would be called instead of rockpool modules, leading to a failing call to.as_graph().
- Brian2 tests are not running -- Brian2 backend will be soon removed
- Bug in Xylo IMU mapper, where networks with more than 128 hidden neurons could not be mapped
-
Dependency on
pytest-random-orderv1.1.0 for test order randomization. -
New HowTo tutorial for performing constrained optimisation with torch and jax
-
Xylo IMU application software support:
mapper,config_from_specificationand graph mapping supportXyloSimmodule: SNN core simulation for Xylo IMUIMUIFSimmodule: Simulation of the input encoding interface with sub-modules:BandPassFilterFilterBankRotationRemovalIAFSpikeEncoderScaleSpikeEncoder
XyloIMUMonitormodule: Real-time hardware monitoring for Xylo IMU.XyloSamnamodule: Interface to the SNN core.IMUIFSamnamodule: Interface toIMUIF, utilizing neurons in the SNN core.IMUDatamodule: Collection of sensor data from the onboard IMU sensor.- Utility functions for network mapping to the Xylo IMU HDK, interfacing, and data processing.
- Introductory documentation providing an overview of Xylo IMU and instructions on configuring preprocessing.
-
New losses, with structure similar to PyTorch.
- PeakLoss which can be imported as
peak_loss = rockpool.nn.losses.PeakLoss(). - MSELoss which can be imported as
mse_loss = rockpool.nn.losses.MSELoss().
- PeakLoss which can be imported as
- Update dependency version of pytest-xdist to >=3.2.1.
- Update to
SequentialAPI.Sequentialnow permits instantiation with anOrderedDictto specify module names.Sequentialnow supports an.append()method, to append new modules, optionally specifying a module name. - Cleaned up tree manipulation libraries and added to documentation. Implemented unit tests.
- Removed obsolete unit tests
- Changed semantics of transformation configurations for QAT, to only include attributes which will be transformed, rather than all attributes. This fixes an incompatibility with torch >= 2.0.
- Added support for latest
torchversions - New fine-grained installation options
- Renamed power measurement dict keys returned by Xylo Audio 2 (
syns61201)XyloSamnamodule, to be more descriptive - Upgrade minimum Python version supported to 3.8
- Upgrade minimum JAX version supported to 0.4.10
- Rearranged Xylo documentation to separate overview, Xylo Audio and Xylo IMU
- Fixed bug in initialising access to MC3620 IMU sensor on Xylo IMU HDK, where it would fail with an error the on the second initialisation
- NEST backend completely removed
- Removed spiking output surrogate "U" from LIF modules
-
Dynap-SE2 Application Software Support (jax-backend)
- jax backend
DynapSimneuron model with its own custom surrogate gradient implementation DynapSamnamodule handling low-level HDK interface under-the-hood- rockpool network <-> hardware configuration bi-directional conversion utilities
- Network mapping:
mapper()andconfig_from_specification() - sequentially combined
LinearJax+DynapSimnetwork getters :dynapsim_net_from_config()anddynapsim_net_from_spec()
- Network mapping:
- transistor lookup tables to ease high-level parameters <-> currents <-> DAC (coarse, fine values) conversions
- Dynap-SE2 specific auto-encoder quantization
autoencoder_quantization()- Custom
DigitalAutoEncoderimplementation and training pipeline
- Custom
samnaalias classes compensating the missing documentation support- unit tests + tutorials + developer docs
DynapseNeurongraph module which supports conversion from and toLIFNeuronWithSynsRealValuegraph- hardcoded frozen and dynamic mismatch prototypes
- mismatch transformation (jax)
- jax backend
-
LIFExodusnow supports training time constants, and multiple time constants -
Improved API for
LIFTorch -
Implemented
ExpSynExodusfor accelerated training of exponential synapse modules -
Added initial developer documentation
-
Added MNIST tutorial
-
Fixed notebook links to MyBinder.org
- Updated Samna version requirement to >=0.19.0
- User explicitly defines Cuda device for LIFExodus, ExpDynExodus and LIFMembraneExodus
- Improved error message when a backend is missing
- Improved transient removal in
syns61201.AFESim
- Weight scaling was too different for output layers and hidden layers.
- Hotfix: Regression in
LIFExodus
- Added support for Xylo-Audio v2 (SYNS61201) devices and HDK
- Added hardware versioning for Xylo devices
- Added a beta implementation of Quantisation-Aware Training for Torch backend in
rockpool.transform.torch_transform - Added support for parameter boundary constraints in
rockpool.training.torch_loss - Added tutorial for Spiking Heidelberg Digits audio classification
- Added tutorial and documentation for WaveSense network architecture
- Added support to
LIFTorchfor training decays and bitshift parameters - Added a new utility package
rockpool.utilities.tree_utils
- Updated support for Exodus v1.1
- Updated
XyloSim.from_specificationto handle NIEN ≠ NRSN ≠ NOEN for Xylo devices - Updated
LIFTorchto provide propertaus for.as_graph()in case of decay and bitshift traning - Improved backend management, to test torch version requirements
- Fixed usage of Jax optimisers in tutorial notebooks to reflect Jax API changes
- Fixed issues with
LIFTorchandaLIFTorch, preventingdeepcopyprotocol - Fixed bug in
tree_utils, whereTreewas used instead ofdictinisinstancecheck - Replaced outdated reference from
FFRateEulertoRatemodule in high-level API tutorial - Fixed seeds in torch and numpy to avoid
nanloss problem while training in tutorial - Fixed bug in
TorchModulewhere assigning to an existing registered attribute would clear the family of the attribute - Fixed a bug in Constant handling for
torch.Tensors, which would raise errors in torch 1.12 - Fixed bug in
LIFTorch, which would cause recorded state to hang around post-evolution, causing errors fromdeepcopy - Fixed bug in
Module._register_module(), where replacing an existing submodule would cause the string representation to be incorrect
Improved handling of weights when using XyloSim.from_specification
Linear...modules now do not have a bias parameter, by default.
- Support for Xylo SNN core v2, via XyloSim. Including biases and quantisation support; mapping and deployment for Xylo SNN core v2 (SYNS61201)
- Added support for Xylo-A2 test board, with audio recording support from Xylo AFE (
AFESamnaandXyloSamna) - Support for an LIF neuron including a trainable adaptive threshold (
aLIFTorch). Deployable to Xylo - New module
BooleanState, which maintains a boolean state - Support for membrane potential training using
LIFExodus
- Xylo package support for HW versioning (SYNS61300; SYNS61201)
- Ability to return events, membrane potentials or synaptic currents as output from
XyloSimandXyloSamna - Enhanced Xylo
mapperto be more lenient about weight matrix size --- now assumes missing weights are zero - Xylo
mapperis now more lenient about HW constraints, permitting larger numbers of input and output channels than supported by existing HDKs - Xylo
mappersupports a configurable number of maxmimum hidden and output neurons - Running
blackis enforced by the CI pipeline Linear...modules now export bias parameters, if they are presentLinear...modules now do not include bias parameters by default- Xylo
mappernow raises a warning if any linear weights have biases LIFSlayerrenamed toLIFExodus, corresponding tosinabs.exoduslibrary name change- Periodic exponetial surrogate function now supports training thresholds
- Fixes related to torch modules moved to simulation devices
- Fixed issue in
dropout.py, where if jax was missing an ImportError was raised - Fixed an issue with
Constanttorchparameters, wheredeepcopywould raise an error - Fixed issue with newer versions of torch; torch v1.12 is now supported
- Updated to support changes in latest jax api
- Fixed bug in
WavesenseNet, where neuron class would not be checked properly - Fixed bug in
channel_quantize, where unquantized weights were returned instead of quantized weights
LIFSlayeris now deprecated
- Improved CI pipeline such that pipline is not blocked with sinabs.exodus cannot be installed
- Fixed UserWarning raised by some torch-backed modules
- Improved some unit tests
- Standard dynamics introduced for LIF, Rate, Linear, Instant, ExpSyn. These are standardised across Jax, Torch and Numpy backends. We make efforts to guarantee identical dynamics for the standard modules across these backends, down to numerical precision
- LIF modules can now train threhsolds and biases as well as time constants
- New
JaxODELIFmodule, which implements a trainable LIF neuron following common dynamical equations for LIF neurons - New addition of the WaveSense network architecture, for temporal signal processing with SNNs. This is available in
rockpool.networks, and is documented with a tutorial - A new system for managing computational graphs, and mapping these graphs onto hardware architectures was introduced. These are documented in the Xylo quick-start tutorial, and in more detail in tutorials covering Computational Graphs and Graph Mapping. The mapping system performs design-rule checks for Xylo HDK
- Included methods for post-traning quantisation for Xylo, in
rockpool.transform - Added simulation of a divisive normalisation block for Xylo audio applications
- Added a
Residualcombinator, for convenient generation of networks with residual blocks - Support for
sinabslayers and Exodus Module,JaxModuleandTorchModuleprovide facility for auto-batching of input data. Input data shape is(B, T, Nin), or(T, Nin)when only a single batch is provided- Expanded documentation on parameters and type-hinting
- Python > 3.6 is now required
- Improved import handling, when various computational back-ends are missing
- Updated for new versions of
samna - Renamed Cimulator -> XyloSim
- Better parameter handling and rockpool/torch parameter registration for Torch modules
- (Most) modules can accept batched input data
- Improved / additional documentation for Xylo
- Improved type casting and device handling for Torch modules
- Fixed bug in Module, where
modules()would return a non-ordered dict. This caused issues withJaxModule
- Removed several obsolete
Layers andNetworks from Rockpool v1
- Added support for the Xylo development kit in
.devices.xylo, including several tutorials - Added CTC loss implementations in
.training.ctc_loss - New trainable
torchmodules:LIFTorchand others in.nn.modules.torch, including an asynchronous delta modulatorUpDownTorch - Added
torchtraining utilities and loss functions in.training.torch_loss - New
TorchSequentialclass to supportSequentialcombinator fortorchmodules - Added a
FFwdStackTorchclass to supportFFwdStackcombinator fortorchmodules
- Existing
LIFTorchmodule renamed toLIFBitshiftTorch; updated module to align better with Rockpool API - Improvements to
.typehintspackage TorchModulenow raises an error if submodules are notTorchmodules
- Updated LIF torch training tutorial to use new
LIFBitshiftTorchmodule - Improved installation instructions for
zsh
- 👹 Adversarial training of parameters using the Jax back-end, including a tutorial
- 🐰 "Easter" tutorial demonstrating an SNN trained to generate images
- 🔥 Torch tutorials for training non-spiking and spiking networks with Torch back-ends
- Added new method
nn.Module.timed(), to automatically convert a module to aTimedModule - New
LIFTorchmodule that permits training of neuron and synaptic time constants in addition to other network parameters - New
ExpSynTorchmodule: exponential leak synapses with Torch back-end - New
LinearTorchmodule: linear model with Torch back-end - New
LowPassmodule: exponential smoothing with Torch back-end - New
ExpSmoothJaxmodule: single time-constant exponential smoothing layer, supporting arbitrary transfer functions on output - New
softmaxandlog_softmaxlosses injax_losspackage - New
utilities.jax_tree_utilspackage containing useful parameter tree handling functions - New
TSContinuous.to_clocked()convenience method, to easily rasterise a continuous time series - Alpha: Optional
_wrap_recorded_state()method added tonn.Modulebase class, which supports wrapping recorded state dictionaries asTimeSeriesobjects, when using the high-levelTimeSeriesAPI - Support for
add_eventsflag for time-series wrapper class - New Parameter dictionary classes to simplify conversion and handling of Torch and Jax module parameters
- Added
astorch()method to parameter dictionaries returned formTorchModule
- Added
- Improved type hinting
- Old
LIFTorchmodule renamed toLIFBitshiftTorch - Kaiming and Xavier initialisation support for
Linearmodules Linearmodules provide a bias by default- Moved
filter_bankpackage from V1 layers intonn.modules - Update Jax requirement to > v2.13
- Fixed binder links for tutorial notebooks
- Fixed bug in
Modulefor multiple inheritance, where the incorrect__repr__()method would be called - Fixed
TimedModuleWrapper.reset_state()method - Fixed axis limit bug in
TSEvent.plot()method - Removed page width constraint for docs
- Enable
FFExpSynmodule by making it independent of oldRRTrainedLayer
- Removed
rpycdependency
- New Rockpool API. Breaking change from v1.x
- Documentation for new API
- Native support for Jax and Torch backends
- Many v1 Layers transferred
- Hotfix to remove references to ctxctl and aiCTX
- Hotfix to include NEST documentation in CI-built docs
- Hotfix to include change log in build docs
- Considerably expanded support for Denève-Machens spike-timing networks, including training arbitrary dynamical systems in a new
RecFSSpikeADSlayer. Added tutorials for standard D-M networks for linear dynamical systems, as well as a tutorial for training ADS networks - Added a new "Intro to SNNs" getting-started guide
- A new "sharp points of Rockpool" tutorial collects the tricks and traps for new users and old
- A new
Networkclass,JaxStack, supports stacking and end-to-end gradient-based training of all Jax-based layers. A new tutorial has been added for this functionality TimeSeriesclasses now support best-practices creation from clock or rasterised data.TSContinuousprovides a.from_clocked()method, andTSEventprovides a.from_raster()method for this purpose..from_clocked()a sample-and-hold interpolation, for intuitive generation of time series from periodically-sampled data.TSContinuousnow supports a.fill_valueproperty, which permits extrapolation usingscipy.interpolate- New
TSDictOnDiskclass for storingTimeSeriesobjects transparently on disk - Allow ignoring data points for specific readout units in ridge regression Fisher relabelling. To be used, for example with all-vs-all classification
- Added exponential synapse Jax layers
- Added
RecLIFCurrentIn_SOlayer
TSEventtime series no longer support creation without explicitly settingt_stop. The previous default of taking the final event time ast_stopwas causing too much confusion. For related reasons,TSEventnow forbids events to occur att_stopTimeSeriesclasses by default no longer permit sampling outside of the time range they are defined for, raising aValueErrorexception if this occurs. This renders safe several traps that new users were falling in to. This behaviour is selectable per time series, and can be transferred to a warning instead of an exception using thebeyond_range_exceptionflag- Jax trainable layers now import from a new mixin class
JaxTrainer. THe class provides a default loss function, which can be overridden in each sub-class to provide suitable regularisation. The training interface now returns loss value and gradients directly, rather than requiring an extra function call and additional evolution - Improved training method for JAX rate layers, to permit parameterisation of loss function and optimiser
- Improved the
._prepare_input...()methods in theLayerclass, such that allLayers that inherit from this superclass are consistent in the number of time steps returned from evolution - The
Network.load()method is now a class method - Test suite now uses multiple cores for faster testing
- Changed company branding from aiCTX -> SynSense
- Documentation is now hosted at https://rockpool.ai
- Fixed bugs in precise spike-timing layer
RecSpikeBT - Fixed behavior of
Layerclass when passing weights in wrong format - Stability improvements in
DynapseControl - Fix faulty z_score_standardization and Fisher relabelling in
RidgeRegrTrainer. Fisher relabelling now has better handling of differently sized batches - Fixed bugs in saving and loading several layers
- More sensible default values for
VirtualDynapsebaseweights - Fix handling of empty
channelsargument inTSEvent._matching_channels()method - Fixed bug in
Layer._prepare_input, where it would raise an AssertionError when no input TS was provided - Fixed a bug in
train_output_target, where the gradient would be incorrectly handled if no batching was performed - Fixed
to_dictmethod forFFExpSynJaxclasses - Removed redundant
_prepare_input()method from Torch layer - Many small documentation improvements
- Introduced new
TimeSeriesclass methodconcatenate_t(), which permits construction of a new time series by concatenating a set of existing time series, in the time dimension Networkclass now provides ato_dict()method for export.Networknow also can treat sub-Networks as layers.- Training methods for spiking LIF Jax-backed layers in
rockpool.layers.training. Tutorial demonstrating SGD training of a feed-forward LIF network. Improvements in JAX LIF layers. - Added
filter_banklayers, providinglayersubclasses which act as filter banks with spike-based output - Added a
filter_widthparameter for butterworth filters - Added a convenience function
start_at_zero()to delayTimeSeriesso that it starts at 0 - Added a change log in
CHANGELOG.md
- Improved
TSEvent.raster()to make it more intuitive. Rasters are now produced in line with time bases that can be created easily withnumpy.arange() - Updated
conda_merge_request.shto work for conda feedstock TimeSeries.concatenate()renamed toconcatenate_t()RecRateEulerwarns iftauis too small instead of silently changingdt
- Fixed issue in
Layer, where internal property was used when accessing._dt. This causes issues with layers that have an unusual internal type for._dt(e.g. if data is stored in a JAX variable on GPU) - Reduce memory footprint of
.TSContinuousby approximately half - Reverted regression in layer class
.RecLIFJax_IO, wheredtwas by default set to1.0, instead of being determined bytau_... - Fixed incorrect use of
Optional[]type hints - Allow for small numerical differences in comparison between weights in NEST test
test_setWeightsRec - Improvements in inline documentation
- Increasing memory efficiency of
FFExpSyn._filter_databy reducing kernel size - Implemented numerically stable timestep count for TSEvent rasterisation
- Fixed bugs in
RidgeRegrTrainer - Fix plotting issue in time series
- Fix bug of RecRateEuler not handling
dtargument in__init__() - Fixed scaling between torch and nest weight parameters
- Move
contains()method fromTSContinuoustoTimeSeriesparent class - Fix warning in
RRTrainedLayer._prepare_training_data()when times of target and input are not aligned - Brian layers: Replace
np.asscalarwithfloat
- New
.Layersuperclass.RRTrainedLayer. This superclass implements ridge regression for layers that support ridge regression training .TimeSeriessubclasses now add axes labels on plotting- New spiking LIF JAX layers, with documentation and tutorials
.RecLIFJax,.RecLIFJax_IO,.RecLIFCurrentInJax,.RecLIFCurrentInJAX_IO - Added
saveandloadfacilities to.Networkobjects ._matching_channels()now accepts an arbitrary list of event channels, which is used when analysing a periodic time series
- Documentation improvements
- :py:meth:
.TSContinuous.plotmethod now supportsstaggerandskiparguments .Layerand.Networknow deal with a.Layer.size_outattribute. This is used to determine whether two layers are compatible to connect, rather than using.size- Extended unit test for periodic event time series to check non-periodic time series as well
- Fixed bug in
TSEvent.plot(), where stop times were not correctly handled - Fix bug in
Layer._prepare_input_events(), where if only a duration was provided, the method would return an input raster with an incorrect number of time steps - Fixed bugs in handling of periodic event time series
.TSEvent - Bug fix:
.Layer._prepare_input_eventswas failing for.Layers with spiking input TSEvent.__call__()now correctly handles periodic event time series
- CI build and deployment improvements
- CI Build and deployment improvements
- Remove deployment dependency on docs
- Hotfix: Fix link to
Black - Add links to gitlab docs
- Hotfix for incorrect license text
- Updated installation instructions
- Included some status indicators in readme and docs
- Improved CI
- Extra meta-data detail in
setup.py - Added more detail for contributing
- Update README.md
- First public release