Allow local llama library usage

[SagsMug]

Sometimes its nice to try different library versions and different forks of llama etc (given they still use the same api).
This commit adds the local path as the first place to search for llama libraries.

[abetlen]

I agree we may need an escape hatch of sorts at the moment (e.g #30 ) and @MillionthOdin16 has brought this up previously in #12 .

I'm not sure the that using the local directory is the right solution, I would prefer something more explicit such as using an environment variable or even a custom function to update _lib in llama_cpp.

[SagsMug]

I agree we may need an escape hatch of sorts at the moment (e.g #30 ) and @MillionthOdin16 has brought this up previously in #12 .

I'm not sure the that using the local directory is the right solution, I would prefer something more explicit such as using an environment variable or even a custom function to update _lib in llama_cpp.

I made it into an environment variable.
A custom function will probably take a bigger refactor because of the way the library is loaded.

[abetlen]

@SagsMug great work

[abetlen]

@SagsMug great work, can we change the environment variable to LLAMA_CPP_LIB

[SagsMug]

@SagsMug great work, can we change the environment variable to LLAMA_CPP_LIB

Done!