Bitnets

[hrstoyanov]

Hello @mukel
There is a very interesting research that shows how to develop matmul-free models, as matrix multiplications are the most expensive operations in any LLM:

https://arxiv.org/abs/2406.02528

I wonder if this can be achieved with Java vectors API?