Commit History

Updated to run docker model, but due to bug in docker model runner it is not working but mlx works
48d7cad

Arif commited on

Docker model runner still error, trying to resolve
89d2b21

Arif commited on

Updated config file so llm use docker model runner ollama style for better reproducable
09c07f9

Arif commited on

Updated backend. Added ML system. Both if mlx is running in debug also docker model runner if not debug mode.
e020ac8

Arif commited on

Finally running backend
3f44a73

Arif commited on