Running with a Predefined Number of Cores

[michaelsheka]

Hi @kherud ,

First of all, thank you for your great project!

I'm trying to run the library with a specific number of cores for parallel processing, but I'm not sure how to set the number of cores to be used by the library. I'd like to configure the library to use a predefined number of cores rather than relying on the default setting.
How can I do it?

Regards,
Michael

[drycoffee]

You can use setThreads in the ModelParameters:

ModelParameters modelParams = new ModelParameters().setThreads(4);
LlamaModel model = new LlamaModel(modelParams);