f131bf1908b8c5dd1f49d7ae7f616506fc471666	33d96dae28e17208ef61a71dba40cda3c04f135a	2026-05-27T09:38:51+08:00	wangbomeng		fix patch of qwen2.5vl,n_patch of minicpm = 64,fix n_ctx_slot,comment out M-ROPE
ebce9e1a548c2329aa97f53b8b2ad50d968088dc	e850ff4de25ad1221abc9bf3bb30df252ccd9c36	2026-05-27T09:38:00+08:00	Yunzhe Jia	origin/runtime_replace	Refactor cal-llm integration by removing runtime capacity loading and adjusting request handling
38ca6895815671a87ceec86b4aa4eb976580ce76	ddd60c928224b52eb4e1e60e01e8a1ecbb80ee45	2026-05-20T16:37:13+08:00	Yunzhe Jia		Add support for cal-llm profile dumping to JSONL file
2716130010c58f1cdd9d94f0e2f8e047bc92dc66	b35bda124ccd4ed581dd6088d3ffa4931c2809b6	2026-05-18T08:40:54+08:00	Yunzhe Jia		fix n_ctx_slot error by adding runtime capacity loading for cal-llm
3b14ed556c15529fe1f94b649f49db7156dfaf67	dde8b8228081769c8d8f1e0751d47fa7875f8423	2026-05-14T14:34:25+08:00	Yunzhe Jia		- Removed references to CALRT from clip.h, mtmd-helper.cpp, mtmd-helper.h, mtmd.cpp, and mtmd.h. - Updated server.cpp to conditionally include CAL-LLM support. - Introduced option LLAMA_SERVER_USE_CAL_LLM in CMakeLists.txt to enable CAL-LLM integration. - Refactored server context to handle CAL-LLM requests and responses. - Updated image processing logic to remove CALRT-specific implementations. - Ensured compatibility with existing llama functionality while integrating new CAL-LLM features.
99dd308adb8488fa869bb669e3335e646a938eff	06c7852e99e34c71e24e3ef6001cb54c72970e4d	2026-04-21T15:50:01+08:00	wangbomeng	tag: v0.2.1	server: fix max_seq_len
ed62eb33447f993d578e156a3c7e38c91b420ece	015e988a271573a7c11e2a4b45084e1219d69d50	2026-04-21T15:05:22+08:00	wangbomeng		try server-test:not success
d8b2aaa00049978cebac15041f960d75b552f97b	b6f29ec8140028619efaa50aa6e73146cecf631d	2026-04-13T11:23:44+08:00	wangbomeng		server: fix context-shift
b6f29ec8140028619efaa50aa6e73146cecf631d	6d55eae7e76b768acfcec045b8e84cded8ae3b55	2026-04-13T11:23:31+08:00	wangbomeng		server: fix context-shift
a2d5bf362d6c9a546f9deadf4f8975605a915d33	bd3a57a11aa008e0b5dc2a30f82fcd3a02587208	2026-04-09T21:01:46+08:00	Bomeng Wang		server: comment fixed time
b8153b6b8f244b223c9f4c2940ae1f212634519e	82842cfc3fa3d5c004c4540aeff8a81f38509bee	2026-04-09T15:07:02+08:00	wangbomeng		server: fix limit tokens to max_seq_len
82842cfc3fa3d5c004c4540aeff8a81f38509bee	622a22991089c6debd5f4b57738f3df3a0bda8b5	2026-04-09T15:06:26+08:00	wangbomeng		server: fix limit tokens to max_seq_len
622a22991089c6debd5f4b57738f3df3a0bda8b5	5f47a738ba56a37d0ff281a16212f41979568e35	2026-04-09T10:36:31+08:00	wangbomeng		server: comment circle print
ecf01a17651cd7b1e8b85fd6075e83831463ee23	99d2078e89305035d87d966cee7987c7d50b3925	2026-04-09T09:47:55+08:00	Yunzhe Jia		fix n_parallel problem
18814f9bf1a423ebe8f32d6043c9cbc5b21b0218	bbee06d6d851e3f84f75b578047967d7e0e4a8dc	2026-04-08T13:55:52+08:00	wangbomeng		server : reset inference time
398ecf71f5f574037ce33f84dd1576fa164909ad	6d5e83902bdd3142a8ff0d3db19f02a8619e95a0	2026-03-27T02:01:23+08:00	wangbomeng		rm llama-server_old.cpp
6d5e83902bdd3142a8ff0d3db19f02a8619e95a0	e4eaab700333490e80ebefc8d023f6c1adfcc312	2026-03-27T00:57:11+08:00	wangbomeng		server: printf calrt commit ID
41e6636ea1fb3884e41fb2023f92b0e7262ef09b	d0a1b2c758440720d42fa108b3444f54593daa73	2026-03-12T16:36:07+08:00	Bomeng Wang	tag: v0.0.1	server: correct the max_seq_len judgment
583c387efaf7bc030574e554088de79d09a27fbd	0edc14a60a2d5596f71d728c655e3523da924d89	2026-02-27T02:24:56+08:00	wangbomeng		caserver: lim generated tokens to n_ctx_per_seq
0edc14a60a2d5596f71d728c655e3523da924d89	aa0a17d719326a63e0d6fea60aa0ced44e7abc33	2026-02-27T01:57:39+08:00	wangbomeng		caserver: limit generated tokens to n_ctx_per_seq
d81d7b190ff5f21325167936496dfe5ab48b922e	e492f5dc8cec17529f53ef2bbdf7b502107f8148 1f5accb8d0056e6099cd5b772b1cb787dd590a13	2025-11-04T14:43:32+08:00	Yunzhe Jia		Merge branch 'master' into dev
48bd26501b08a3f0bff1249db47f313641f7bebb	622cd010ff4a65bef67edbf2f9bf4707c01f98f7	2025-11-03T15:38:23+02:00	Georgi Gerganov		server : add props.model_alias (#16943)
cd5e3b57541ecc52421130742f4d89acbcf77cd4	87c9efc3b297b8a498716b1db3d061842e6fc85b	2025-11-02T18:14:04+02:00	Georgi Gerganov		server : support unified cache across slots (#16736)
2f68ce7cfd20e9e7098514bf730e5389b7bba908	e4a71599e5846110159955dec0008eb4aa24222b	2025-11-01T19:49:51+01:00	Pascal		webui: auto-refresh /props on inference start to resync model metadata (#16784)
e4a71599e5846110159955dec0008eb4aa24222b	dd5e8cab512c7752392b6e51a6f118f348fb3f16	2025-11-01T17:14:54+01:00	Pascal		webui: add HTML/JS preview support to MarkdownContent with sandboxed iframe (#16757)
c22473b580807929fd9e3a3344a48e8cfbe6c88f	0f715b4e759acceccb9f437cfd2a988fff85514a	2025-10-31T10:54:19+02:00	Georgi Gerganov		server : don't print user inputs to console (#16871)
0f715b4e759acceccb9f437cfd2a988fff85514a	d2d931f173b8a736b08999436e9259aafddec718	2025-10-31T09:51:26+01:00	Daniel Bevenius		server : fix typos in server.cpp comments [no ci] (#16883)
16724b5b6836a2d4b8936a5824d2ff27c52b4517	b52edd25586fabb70f0c21b274473b307cf14499	2025-10-30T14:22:23-04:00	chansikpark		server : bump request URI max length to 32768 (#16862)
b52edd25586fabb70f0c21b274473b307cf14499	517b7170e1a4d733583c4b07c5b7a49acc05911c	2025-10-30T18:42:57+02:00	Georgi Gerganov		server : remove n_past (#16818)
8b11deea4663f29d3e042ce1056ba643264cd5f1	b9ce94017729465895402cbcfffb51fa926c15e3	2025-10-30T04:34:15+01:00	Oliver Simons		Hide latency of bias and gate-loading (#16847)
3eb2be1ca5f37480aeb16102970d9e65f43347fe	e41bcce8f0b53032a1fed275cd253e931c041cf6	2025-10-29T06:29:12-07:00	Max Krasnyansky		Hexagon Op queue & dispatch optimizations (#16820)
338074c383c81366320d176d83b94b0a567ee0c2	851553ea6b24cb39fd5fd188b437d777cb411de8	2025-10-29T08:14:39+02:00	YaelLogic		sycl: add RMS_NORM_BACK operation support (#16808)
85a7d8677bf2200981e52f744a21d5267964ffcf	a8ca18b4b815a2abdbecb958ee5f4c542d69aac7	2025-10-28T20:19:44+02:00	Georgi Gerganov		memory : remove KV cache size padding (#16812)
ad8d36beffd791db10c94eb9e964afb891e3ca55	c053e18a66dd95dc340aa61317877c2a41d4e3cf	2025-10-28T03:50:33+02:00	tamarPal		sycl: add SSM_CONV operation support (#16800)
5a4ff43e7dd049e35942bc3d12361dab2f155544	10640e31aab0819f31c1e1f2d008b019ee737232	2025-10-27T13:51:28-07:00	Diego Devesa		llama : disable pipeline parallelism if compute buffer allocation fails (#16748)
0bf47a1dbba4d36f2aff4e8c34b06210ba34e688	dd62dcfab97e420949519fd0eac9fca7bf97e635	2025-10-23T21:30:17+02:00	Johannes Gäßler		server: add memory breakdown print (#16740)
8cf6b42d467d05fa7d9776d2bcc69974ecce6900	9de9672adb0f4ca4e39483ac3ffed52b3f70a55d	2025-10-23T11:32:24+02:00	matteo		server : send partial stop string when <EOG> is reached (#15007)
63d2fc46e17a06be5b4b5823a5ada088317f1f0a	a2e0088d9242bd9e57f8b852b05a6e47843b5a45	2025-10-22T13:47:09-07:00	Max Krasnyansky		Add experimental ggml-hexagon backend for the Hexagon NPU (#16547)
9b9201f65a22c02cee8e300f58f480a588591227	19a5a3edfd306516cc419679d69d6435943b6816	2025-10-22T16:58:23+02:00	Pascal		webui: introduce OpenAI-compatible model selector in JSON payload (#16562)
13f2cfad4170c096c51a02c24a6a158cb47f1480	06332e28672356b964d6dfc2ba4657e20581cd43	2025-10-20T12:41:13+02:00	Aleksander Grygier		Enable per-conversation loading states to allow having parallel conversations (#16327)
41386cf365d894134ee0813d15e2f5d76f6a4d8e	3d4e86bbeb15f487d6da6174ba6191b7c212cc25	2025-10-17T18:02:52+03:00	Radoslav Gerganov		rpc : report actual free memory (#16616)
466c1911ab736f0b7366127edee99f8ee5687417	0cb7a0683b0529172472d74d21f05470a607f297	2025-10-15T22:24:51+03:00	safranowith		cpu : add FLOOR, CEIL, ROUND and TRUNC unary operators (#16083)
f9fb33f2630b4b4ba9081ce9c0c921f8cd8ba4eb	f4ce81c45e7bd910e36bf44c253fc5255c49b1e4	2025-10-15T16:22:20+02:00	Aleksander Grygier		Add server-driven parameter defaults and syncing (#16515)
17304cbcc1dd24de7741cbe57925d58e90a98ac1	3e3cb19f6449f9168a128eaeae01f8f41b049acc	2025-10-15T16:53:12+03:00	Georgi Gerganov		server : fix img token logs (#16595)
554fd578a5ed78a10f371f5850c6a69aa83df15a	fa882fd2b1bcb663de23af06fdc391489d05b007	2025-10-15T12:51:27+03:00	Georgi Gerganov		server : fix mtmd checkpoints (#16591)
7ea15bb64c81e3813eb0babf9a57e1bc5697f569	9c7185dd28416cf67f5e3b268381f311b5e3da56	2025-10-14T07:51:36-05:00	Jeff Bolz		vulkan: Improve build time for MSVC (#16545)
bc07349a7f87ba6eb31ed4b0ea9d9a7352185213	e60f241eacec42d3bd7c9edd37d236ebf35132a8	2025-10-14T08:48:50+03:00	Georgi Gerganov		server : dynamic token limit for prompt cache (#16560)
81d54bbfd599811b354c39f04550888168be7780	c7be9febcbafa9af7d1b9443f86475c59c9c5f87	2025-10-12T18:06:41+02:00	Pascal		webui: remove client-side context pre-check and rely on backend for limits (#16506)
31d0ff1869aa2ea31f4e96d5877d0343e9a2171b	97870e64975b26c5e06a3540a8dc0ff601351e86	2025-10-11T21:39:04+08:00	Yann Follet		server / ranking : add sorting and management of top_n (#16403)
e60f01d941bc5b7fae62dd57fee4cec76ec0ea6e	81086cd6a3ca1252f0dc0f938171648399179c53	2025-10-10T22:15:05+03:00	Georgi Gerganov		server : fix division by zero when reporting stats (#16501)
68ee98ae181a5c83a5cc6261daeee69a1f588c15	cdb6da468cc33323955a523738d2e1675aeb5e9a	2025-10-10T17:11:07+03:00	Radoslav Gerganov		server : return HTTP 400 if prompt exceeds context length (#16486)
cdb6da468cc33323955a523738d2e1675aeb5e9a	6d69ab3f262eca3f0c6ad0ce075d2c80b9924d0e	2025-10-10T13:22:27+03:00	Radoslav Gerganov		server : log requests to /v1/completions (#16495)
1faa13a1187051af66b0fd9f0d6effe4c77f0b3e	1deee0f8d494981c32597dca8b5f8696d399b0f2	2025-10-09T22:54:57+02:00	Pascal		webui: updated the chat service to only include max_tokens in the req… (#16489)
d00cbea63c671cd85a57adaa50abf60b3b87d86f	8328fd4bae76fc027f8ca0e9a05acd3788dabe3f	2025-10-09T18:54:51+03:00	Georgi Gerganov		server : host-memory prompt caching (#16391)
12bbc3fa50b6df03318a4451c9a2210200a0b28d	9d0882840e6c3fb62965d03af0e22880ea90e012	2025-10-08T22:18:41+02:00	Pascal		refactor: centralize CoT parsing in backend for streaming mode (#16394)
d2ee056e1df0fdf646270fb5621e9f92084b59a7	b2c08c9ec4cd59ed88c1ebdd94f109af5ccc978e	2025-10-08T17:20:18+09:00	issixx		server : fix cancel pending task (#16467)
7fdd16b432d247121fe5fe7b21f8805f85266c85	74b8fc17f92ada295a648e3c5eb28f46bca7d892	2025-10-08T10:57:29+03:00	Georgi Gerganov		server : improve context checkpoint logic (#16440)
df1b612e29ba97a2e67db339b1e8c7465702b7e8	4e0388aa8a1f4ef1065701dc9c3947aea0a1b9a5	2025-10-07T15:57:14+03:00	Georgi Gerganov		server : add `/v1/health` endpoint (#16461)
c61ae20d05bd4fdd8551311325a2845336449426	0123ff38f53d34752f29239a29d0e40a6dc4110f	2025-10-07T09:59:13+03:00	Radoslav Gerganov		rpc : update documentation (#16441)
c5fef0fcea3b978a2318b1af170209ecec7c37b4	ca71fb9b368e3db96e028f80c4c9df6b6b370edd	2025-10-06T03:53:31-04:00	Oleksandr Kuvshynov		server: update readme to mention n_past_max metric (#16436)
898acba6816ad23b6a9491347d30e7570bffadfd	e29acf74fea996014380d59d31aa504ae8964258	2025-10-04T12:49:16+03:00	Radoslav Gerganov		rpc : add support for multiple devices (#16276)
f6dcda390004b627ef30af378d0c01ad2519289e	606a73f53175077429484b23dcf799f69a31d0bd	2025-10-03T13:34:51-05:00	ddh0		server : context checkpointing for hybrid and recurrent models (#16382)
ad126479c25cf983a0f994a08ba0911cf49ed62b	77233277c912d495d1069543ca540c21a2f9e5b4	2025-10-03T11:45:16+02:00	Daniel Bevenius		ci : change macos-13 to macos-15-intel (#16401)
77233277c912d495d1069543ca540c21a2f9e5b4	e308efda8e54e3f07578937a45a5d83624eb7970	2025-10-03T11:30:39+02:00	Aleksander Grygier		Capture model name only after first token (streaming) or completed request (#16405)
136bda78c5679b266362b39c58338fff46fd2592	5113efd34ceda709292de26c72716c49e024fb32	2025-10-03T09:11:34+02:00	Aleksander Grygier		webui : Fix messages payload sent to chat completions (#16402)
2be72c2b121ee99f33927149265ce6073ade9e59	95ce0985449c52fb9d6849b95563f7cf933ea0e3	2025-10-02T15:16:25+08:00	Neo Zhang Jianyu		SYCL: Update to oneAPI 2025.2 (#16371)
aa9538a63aef35f0224b2502f13b19d650a8ce04	e74c92e84236b2bab3f3c77bee4ead94928be360	2025-10-01T07:40:26+02:00	Aleksander Grygier		webui: Remove running `llama-server` within WebUI `dev.sh` script (#16363)
16b0ca0d2e63fc1a0a43795f8552f9cb61d9f7a5	8d78cd2613ccdeb3cc86f59bc8f9ddd31cfbd3ed	2025-09-30T19:18:54+02:00	Pascal		Chatapi ignore empty sampling (#16330)
98c8269abefdfa8fde47dfb2769ceebc8b704e86	2790ecc304e384d9075c55d0628d8bf440025dc4	2025-09-30T17:42:57+08:00	Yunzhe Jia		server: adapt to calrt
2811c65286ae954bec87049f75b86dc022006dcc	d8359f5fde480da030bf75c7711573c7c4d993ba	2025-09-28T12:04:46+01:00	Imad Saddik		Fixed a few typos in the README of the LLaMA.cpp HTTP Server [no ci] (#16297)
234e2ff8ed09716fb553437596779399bee31b11	3f81b4e91c1d5f098148af117e3f13cf4b077f52	2025-09-27T18:17:08+02:00	Adrien Gallouët		server : remove old LLAMA_SERVER_SSL (#16290)
1a189278944d030211f336e103e96b65f976c361	e0539eb6aed346d4b25a6ea019044e88771e7690	2025-09-26T18:35:42+02:00	Aleksander Grygier		Allow viewing conversations even when llama server is down (#16255)
d0991da39d3c39b3980c24cdfccb9a4c95a46870	aa719c2f886c445b78113bf1e5849f1fce4124a7	2025-09-25T11:36:47+02:00	Daniel Bevenius		server : add support for external server for tests (#16243)
c498fc82fe5b83fc8c6e1627286bdc1f93caddbf	e7a5130a20cf45a3358308356c249734ca982143	2025-09-25T10:20:02+03:00	Radoslav Gerganov		rpc : use ggml logging facilities
4b9f4cb0f89a88de4bdf97727d0457b0c648804c	85e72271ba1ce78adf34fd8997803c991e617ca6	2025-09-23T13:59:34+08:00	Aaron Teo		devops: add s390x containers (#15915)
5c6106a696af2b00ce01d14ba525979d5a32b199	ec65fb52f0cc890e5085a6c5995ab08a156265fb	2025-09-22T10:58:02+03:00	Georgi Gerganov		contrib : update roles (#16113)
1eeb523c3e0c7ffbd59469f5463dcbdecba3535e	5bb4a3edec297e74b0f7bd4ed5d0fdd12e28d858	2025-09-21T08:31:55+02:00	Giuseppe Scrivano		vulkan: optimize UMA buffer operations and fix driver hangs (#16059)
459c0c2c1a400f960d7b8e8d94d31a8426f80986	be79d9fdd95ab8955527c4aaa67b90e8b9516718	2025-09-20T07:56:30+02:00	Benni		server: fix SSE and OpenAI compatibility for error messages when streaming (#16109)
be79d9fdd95ab8955527c4aaa67b90e8b9516718	f432d8d83e7407073634c5e4fd81a3d23a10827f	2025-09-19T15:15:21-07:00	ssweens		llama-bench: add --devices and --list-devices support (#16039)
246c0d9c795fb25da8268625d597580155a3672f	3edd87cd055a45d885fa914d879d36d33ecfc3e1	2025-09-18T23:07:18+02:00	Adrien Gallouët		cmake : fix static linking for OpenMP on Unix-like systems (#16031)
4ca088b036313c2d8e682f4cfeb7c29edd85d0b9	703f9e32c4eb3166f8d63007c26e31a1466c21af	2025-09-18T16:22:50+01:00	Eric Curtin		Add resumable downloads for llama-server model loading (#15963)
2b6b55a59f590a1e1eb2dcd09d5b8b6feb9cc748	e58174cecbc45bf79bf653cd2c984395940c6ef4	2025-09-18T13:36:57+03:00	Radoslav Gerganov		server : include usage statistics only when user request them (#16052)
0320ac5264279d74f8ee91bafa6c90e9ab9bbb91	a7a98e0fffed794396b3fbad4dcdbbc184963645	2025-09-17T20:38:12+03:00	Georgi Gerganov		metal : refactor + optimize v2 (#15995)
8ff206097c2bf3ca1c7aa95f9d6db779fc7bdd68	77475530b8bbea3bf578632507e1284cdfe2c8c0	2025-09-16T16:17:08+02:00	jacekpoplawski		llama-bench: add --n-cpu-moe support (#15952)
b907255f4bd169b0dc7dca9553b4c54af5170865	28c39da7c645185ade5436767929d7ec33006033	2025-09-15T19:51:35+03:00	yael-works		SYCL: Add COUNT_EQUAL operator support (#15991)
6c019cb04e86e2dacfe62ce7666c64e9717dde1f	9dcd200d57bc6f05a59a6a8df361d5d183af4124	2025-09-14T21:17:04+02:00	Sigbjørn Skjæret		server : only attempt to enable thinking if using jinja (#15967)
50f4281a6f5c3a5d68bdeb12f904fa01e0e2ba91	55758b00cae1451a0d789c50a5eb8c9bee42b9a0	2025-09-13T07:49:49-07:00	Diego Devesa		llama : allow using iGPUs with --device (#15951)
4bf5549269d99bac936a65892da2312cc71b2421	f4e664f838cc65d89fa845c48c372e43852112e4	2025-09-12T16:31:50+01:00	Eric Curtin		Add docker protocol support for llama-server model loading (#15790)
f088b6a84f6aed0abb619dbb9d375e726fc888a6	304ac5693d1e2124f83e0584bc5eea6311d3d3b4	2025-09-12T17:02:55+03:00	Georgi Gerganov		server : adjust prompt similarity thold + add logs (#15913)
304ac5693d1e2124f83e0584bc5eea6311d3d3b4	6c88ad8fa741a2182a2dcf8c5353ae4b5c66e656	2025-09-12T13:24:21+02:00	Ruben Ortlam		Vulkan iGPU device selection overhaul and PCI ID API support (#15947)
e68aa10d8f3d26fdad5b912540362d79de5460e3	0a16bf52e6874369cb4fd2bdc4863ef984b688e7	2025-09-08T13:10:07-05:00	Jeff Bolz		vulkan: sort graph to allow more parallel execution (#15850)
88021565f08e0b7c4e07ac089a15ec16fae9166c	56920f56651908d5cce7a310dabf54ac4f6fbb7f	2025-09-08T10:59:48-04:00	Jesse		chat : Deepseek V3.1 reasoning and tool calling support (OpenAI Style) (#15533)
56920f56651908d5cce7a310dabf54ac4f6fbb7f	b0d52998b962bd2681c34bf52af993af79f178b8	2025-09-08T21:50:05+07:00	Xuan-Son Nguyen		server : bring back timings_per_token (#15879)
3b15924d71237a43bb5ad71f5b885ee66a821342	79bc429262268ad2ac8a364cfe6c2d6b9c5f008a	2025-09-07T10:19:45+02:00	Daniel Bevenius		ggml WebGPU: remove userdata from request adapter callback (#15527)
3c3635d2f20424d557b5b0605a2a356214ffe048	61bdfd5298a78593be649a1035ee2a120b13c4f0	2025-09-06T19:45:24+07:00	Xuan-Son Nguyen		server : speed up tests (#15836)
61bdfd5298a78593be649a1035ee2a120b13c4f0	01806e77714ae8a78130d432945b959a0956c56f	2025-09-06T18:35:04+07:00	Xuan-Son Nguyen		server : implement prompt processing progress report in stream mode (#15827)
fd621880f3fd908424e675a41715a2dc760247a2	4281c7b315f8a904549fe527039b976e08098d1a	2025-09-05T17:32:39-06:00	Gabe Goodhart		aLoRA Support (#15327)
5fac79cbc77b6d12c9feb5f34fc63586b35fd561	408ff524b40baf4f51a81d42a9828200dd4fcb6b	2025-09-05T14:31:24-06:00	Gabe Goodhart		Thinking model disabled assistant prefill (#15404)
dcbe998a6d8f13b6c9cb36bbe7b355ced2ac3842	87932ec016f0ec81e98a13ce5212851f8c12458a	2025-09-05T14:34:07+08:00	Yunzhe Jia		add calrt API used in server side
5d6688de08e73acc2532d668380801ed79d704eb	4fd1242bef6cb2325b4ff1c1a80f3b54b64508a6	2025-09-05T04:36:23+02:00	Daniel Bevenius		model-conversion : add --embeddings flag to modelcard.template [no ci] (#15801)
c1c354e44c06d259679bb5bb7a8fa9f0b28480e4	a68d9144262f1d0ef4f6ba7ad4a7e73e977ba78c	2025-09-04T20:20:14+08:00	Chenguang Li		CANN: Refactor ND to NZ workspace to be per-device (#15763)
a68d9144262f1d0ef4f6ba7ad4a7e73e977ba78c	badb80cadbc40e047b30c43611aba575fc8d6845	2025-09-04T11:50:23+02:00	Xuan-Son Nguyen		server: add exceed_context_size_error type (#15780)
8c3fdf44ecf08335942f2ba558955f55e88c7991	f6da8cb86a28f0319b40d9d2a957a26a7d875f8c	2025-09-03T09:48:35+02:00	Daniel Bevenius		model-conversion : add missing curl script [no ci] (#15761)
0d161f021aa33ec0e90cce96f5d1a88925557327	4efd5a83163ff383285b3a4c2106feabf5c69557	2025-08-31T20:11:58+03:00	Georgi Gerganov		server : enable /slots by default and make it secure (#15630)
d82f6aa34a216f5df1945cdfe121ba5e6cd80be0	3d16b29c3bb1ec816ac0e782f20d169097063919	2025-08-30T00:12:53+02:00	Sergey Alirzaev		server : removed obsolete doc (#15670)
792b44f2ed9668cce7f267ff0ae4950ed9b4a5de	81017865ee444cf49ce0136f2be1e41a0270ff91	2025-08-29T19:25:40+02:00	ExtReMLapin		server : add documentation for `parallel_tool_calls` param (#15647)
c8d0d14e77c3c45df5cbbddde9c2b4c377ec4e7a	84ab83cc0b4b7e769451ee48e4c7d1acef91ef25	2025-08-28T17:09:05+03:00	Georgi Gerganov		kv-cache : fix find_slot to not search for continuous slot (#15638)
84ab83cc0b4b7e769451ee48e4c7d1acef91ef25	55042b3692cb1467c9ee15c62c4a9fbf180f89e3	2025-08-28T15:49:50+02:00	Sigbjørn Skjæret		model : jina-embeddings-v3 support (#13693)
fbef0fad7a7c765939f6c9e322fa05cd52cf0c15	da54f9f1a2db07aaae390024ac466e7867685d94	2025-08-27T20:58:09+02:00	Johannes Gäßler		server: higher timeout for tests (#15621)
0115cfb7c1dec0753aecb34f3af4338bf9de8eeb	3a617cb18121a85eed17ac5585788810c5d9c1e0 0d5a470223fc90b6b6807921d68011ff06ae7f9e	2025-08-26T15:19:56+08:00	Yunzhe Jia		Merge branch 'master' into dev
5a6bc6b1a6cb665a944426c2055794950e524bf5	6b64f74b55628e4193f4fb00313f07dbd8556528	2025-08-25T14:25:25+02:00	Daniel Bevenius		model-conversion : add model card template for embeddings [no ci] (#15557)
611f419cff11e4952228162a1c44cb35dff2274a	b1afcab804e3281867a5471fbd701e32eb32e512	2025-08-23T13:16:17-05:00	Jeff Bolz		vulkan: optimize rms_norm, and allow the work to spread across multiple SMs (#15281)
4afb0a746f22abaa545b3ebdb76a400d7da3a713	e288693669cf9d0a71e2f2b8bd57305f06340257	2025-08-22T08:10:14Z	65a		server : Support multimodal completion and embeddings prompts in JSON format (#15108)
cd36b5e5c7fed2a3ac671dd542d579ca40b48b54	3f196be84b1376945737163e35a91e29e3e24d2f	2025-08-21T19:13:45+03:00	Georgi Gerganov		llama : remove deprecated llama_kv_self API (#15472)
245be739df942861ddc52331b095b40f18e2a3f1	b2caf67db1208fd38a0570785c39f7370d906d8a	2025-08-21T11:47:52+02:00	Copilot		ci : add copilot-instructions.md (#15286)
1b0db8f6e08951969e2447c2d18bf638effb8f75	29f538ac630d6544406a0702476e36808a6bd1b3	2025-08-21T07:19:22+02:00	stduhpf		server : fix webui (#15462)
1bc664a26a1d93a48baf2483a7ff95291ca8bcb8	13aeb7aef284daed4ad07dc14b4b3e2a42b5ea97	2025-08-21T07:10:08+09:00	teo		server: fix OpenAI API compatibility for usage statistics in chat streams (#15444)
1a99c2d948209d9ea5eac8b6dc0a297107244540	37f10f955f70e0158d50343d0b9a3f92d194daae	2025-08-20T18:32:05+08:00	xiaobing318		cmake : fix target include directories (#15450)
d2fcd91cf96b46f4485ce46b4e3a32bf0df37715	a6d3cfe7fa6ea1fb0e1ba8243b731db22ddc0b49	2025-08-19T16:46:37+03:00	Georgi Gerganov		server : disable context shift by default (#15416)
9d262f4bad0d37838100133537aaf0a83835ed12	f0d3c7405c323784a60f14ddddfbac3f7404d417	2025-08-19T08:45:26+03:00	Georgi Gerganov		server : remove swa_full warning (#15399)
d1d82416006e7ff41780cb0e9b5f28d30a267497	618575c5825d7d4f170e686e772178d2aae148ae	2025-08-18T16:51:42+02:00	davidef		server : fix incoming tasks not process in order (#15395)
e5155e698645242d4f019267ecc40ea9bad81b09	21c17b5befc5f6be5992bc87fc1ba99d388561df	2025-08-17T18:28:58-04:00	Oleksandr Kuvshynov		server : export max observed n_past value (#15361)
de2192794f4e8e04f2e8167ef2424905145e88fc	2e2b22ba6607414a5d619ac6d2f034b5b02214e5	2025-08-16T04:18:31-05:00	Jeff Bolz		vulkan: Support mul_mat_id with f32 accumulators (#15337)
ff27f80a74bbe5303acd511a6781a1de6d619b3c	d3248d9b6557c75d59954c594bb53cf517591e91	2025-08-15T21:11:22+08:00	Aaron Teo		ggml: initial IBM zDNN backend (#14975)
5ba36f61033d2819be27e2abb70e9a3bd20c0fde	b204a5a234f4cf0b3f449476da639a5510c6d157	2025-08-14T16:23:56+02:00	uvos		HIP: Cleanup hipification header (#15285)
b204a5a234f4cf0b3f449476da639a5510c6d157	646944cfa8961afd914dd6637739b3cda9a72e11	2025-08-14T09:23:11-05:00	Aldehir Rojas		gpt-oss: implement harmony parsing (#15181)
d32e03f4495d3efa1c5126f53b449f1d429c5664	3973163bff40f7f5161b0f08a0011729e2b0406a	2025-08-14T14:59:50+03:00	Georgi Gerganov		server : add SWA checkpoints (#15293)
b3e16665e14032d1276f9d0263acef8321b6f518	c24f4e26883a91219af5acfaf1471ca7ef582683	2025-08-13T15:43:00+02:00	Sigbjørn Skjæret		server : enable -td and -tbd parameters (#15172)
e885445bc1719d2e289a9b2e11714e0f994e68be	648ebcdb739abfb5a9be14f4c5c0fd19ff268ef0	2025-08-13T05:28:21-05:00	Aldehir Rojas		server : filter out harmony thought messages (#15278)
07aa869a91837d95fcb5612c65a188763ac38647	00f35d509e5367bf19ccaf4b4adddc38db4811c6	2025-08-13T11:30:45+02:00	Sigbjørn Skjæret		ci : add more python requirements to copilot-setup-steps (#15289)
6028bf74351d35a06bd98498624f8c2f029f7d1a	bc5182272c373267352bc689e5fca276934bea2d	2025-08-13T10:04:46+02:00	Oliver Simons		CUDA: Optimize `reduce_rows_f32` kernel, leading up to 25x perf improvement on kernel-level and 10% perf increase for Gemma3n (#15132)
53d0a1265826f40c5dbc01d06aeab9e14fcbd69b	27093afe78912494073eb043fec93a007e49653c	2025-08-11T14:48:41+02:00	Xuan-Son Nguyen		server : allow specifying reasoning_format in HTTP request (#15238)
cd3069dfcbeee8e0e96cffb93b0ebb9e595e273a	50e81bdf5db563ab57a9a722b08f96fa8a76c927	2025-08-11T11:21:19+02:00	Daniel Bevenius		kv-cache : log (debug) all streams in find_slot (#15176)
4850b52aedceeb70bb4fe49f2d7cd1df6ee98682	cd6983d56d2cce94ecb86bb114ae8379a609073c	2025-08-08T23:04:36+02:00	Johannes Gäßler		server-bench: external OAI servers, sqlite (#15179)
36d3f00e142696f708ab297b9f8f1c825594712d	5fd160bbd9d70b94b5b11b0001fd7f477005e4a0	2025-08-07T05:31:48+02:00	Daniel Bevenius		requirements : fix PyTorch uint64 compatibility (#15134)
c42293848dd9f03eba9a6c1b85a600b398f06541	1cbf442f50a154aac0bf35d7b8b3436a2cdfd6f5	2025-08-06T15:46:06+08:00	Yunzhe Jia		sync with calrt API
f906275537d14c8fc7c6976d944233771fd6672c	a9f7541ec25c4c8547daf5ff48700ad2836e2b7d	2025-08-02T10:12:41+02:00	Johannes Gäßler		server: enable token array inputs for OAI API (#15001)
94933c8c2eeaa9a7983e3f6c08af76bd86724094	c1dacaa99b4ead6edbac928cd2da59436573f6b0	2025-07-31T05:25:23-07:00	g2mt		server : implement universal assisted decoding (#12635)
a9f77a8be348deeb11fb3d54d412bf583003c90d	8a4a85627702b569d7d2810f2de06a4321656e9d	2025-07-31T14:08:23+02:00	Lukas Straub		server : add openai-style logit_bias support (#14946)
41e78c567e9a8c652e405f4f909deb598deecd31	ad4a700117d1746799d2d6599e526e2c3a7938d2	2025-07-30T18:07:11+02:00	Daniel Bevenius		server : add support for `embd_normalize` parameter (#14964)
00131d6eaf4df029e1ec84de868c2c5957503007	1e15bfd42c3938506e0da5939bf7f42780965f01	2025-07-30T15:12:02+03:00	Georgi Gerganov		tests : update for LLAMA_SET_ROWS=1 (#14961)
bbd0f917797e9d524680f1b30d34a46eb06d7651	0a5036bee9cfb946870689db4400e9e0d17844c9	2025-07-29T10:40:50+02:00	Johannes Gäßler		server-bench: make seed choice configurable (#14929)
c556418b600ad5792440942079d93e393595688b	db16e2831c0f344f041af3d067db81c42b16eb22	2025-07-28T18:59:04+03:00	Radoslav Gerganov		llama-bench : use local GPUs along with RPC servers (#14917)
f1a4e72de5950ab7136aeadddd675caf30dd6b3f	4762ad7316dcdec20016ab5985fb46a27902204d	2025-07-27T04:05:34-05:00	Jeff Bolz		vulkan: skip empty set_rows to avoid invalid API usage (#14860)
793c0d7f46384001738c337d7afa46b45ae32745	ce111d39d666f4a3b6a561ad020f6feb8cc67790	2025-07-25T10:47:39-06:00	Gabe Goodhart		metal: SSM_SCAN performance (#14743)
c12bbde37258c6d053322d1cedd4a9672109ae58	3f4fc97f1d745f1d5d3c853949503136d419e6de	2025-07-25T01:07:26-07:00	Diego Devesa		sched : fix multiple evaluations of the same graph with pipeline parallelism (#14855)
3f4fc97f1d745f1d5d3c853949503136d419e6de	2df255da3cea108de0ae9b302ffdd31674b6d88d	2025-07-25T03:05:37+08:00	R0CKSTAR		musa: upgrade musa sdk to rc4.2.0 (#14498)
adef81781a15083f218eae6c488b95cdad781971	48b86c4fdb1b1246d9fe17d2d53e3a1c2a0c3245	2025-07-22T09:24:22+08:00	Molly Sophia		server : allow setting `--reverse-prompt` arg (#14799)
b4efd77f8ab407836ca73a5176f041650c5b2411	2be60cbc2707359241c2784f9d2e30d8fc7cdabb	2025-07-21T09:24:51+02:00	IsaacDynamo		server : add parse_special option to /tokenize endpoint (#14783)
2adf8d83acdb9b1bf58db6c9729ac9dc6847a58b	021cc28bef4dd7d0bf9c91dbbd0803caa6cb15f2	2025-07-18T17:33:41+03:00	Georgi Gerganov		parallel : add option for different RNG seeds (#14757)
086cf81e88fb75287b71ff19c08a206b7bc2e02f	d9b691081c04ec5fb0daa9d2b979f915c142963d	2025-07-17T09:22:11+02:00	Tarek Dakhran		llama : fix parallel processing for lfm2 (#14705)
225e7a1438f4ea85eaa7b5ef3ab3b266ee4d9c06	ab140198211385b85eeeb0abd549a4bbe259e10d	2025-07-16T16:35:42+03:00	Georgi Gerganov		llama : add high-throughput mode (#14363)
6ffd4e9c442e99afac3d138543ebf86d5fc5ee03	e4841d24d3485ea4af54f8b65a19ec3123f0ff3c	2025-07-16T14:04:12+03:00	Georgi Gerganov		server : pre-calculate EOG logit biases (#14721)
e4841d24d3485ea4af54f8b65a19ec3123f0ff3c	538cc77f7f44dfa047dba6a06d90c86dda69cf1d	2025-07-16T19:12:22+09:00	Shunta Saito		llama : fix parallel processing for plamo2 (#14716)
538cc77f7f44dfa047dba6a06d90c86dda69cf1d	5cae76654113160f691f581930b69fc5535e8159	2025-07-16T12:13:57+03:00	Georgi Gerganov		server : fix handling of the ignore_eos flag (#14710)
5cae76654113160f691f581930b69fc5535e8159	4b91d6f71f14040979bcdb7b6729b3bca93ec1c1	2025-07-16T09:33:28+02:00	Johannes Gäßler		scripts: synthetic prompt mode for server-bench.py (#14695)
79e0b68c178656bb0632cb8602d2940b755077f8	c81f4192f91a1e209c1eec7a84fe5371ef9175da	2025-07-16T12:00:42+08:00	Min-Hua		llama: add LLAMA_API to deprecated llama_kv_self_seq_div (#14708)
494c5899cb76859f32ddd913534f2685fd684a3d	0f4c6ec0f1a9607ba67071f8a02c69b0afc2f91e	2025-07-14T13:14:30+02:00	Johannes Gäßler		scripts: benchmark for HTTP server throughput (#14668)
0c1df14b5f8d992805cb22d0b77b44092a18aeab	b3ad3a0191994d6c47b2bd389d5c7431526ecd2c	2025-07-12T06:21:02-04:00	Douglas Hanley		server : fix pooled embedding output (#14645)
0aedae00e6fb48680324a5ac5da9cba0e35de6b5	6bdda13981d6c8189b7dc4f9fb8ecb91c21529f8	2025-07-10T18:20:13-06:00	Gabe Goodhart		model : Granite Four (#13550)
4a5686da22057867c23bd4a6be941ddc8c51e585	98bab638fb28cf95a5a66dd2d51b40d6c8f6d69a	2025-07-09T14:59:57-04:00	compilade		llama : support Jamba hybrid Transformer-Mamba models (#7531)
04655063c47af6cbced295c8c7ad369402b15300	20b7bf8a32259ad9189a4797fd3e3a859c537b99	2025-07-09T12:03:49+04:00	ibrahim khadraoui		model : add support for Falcon-H1 family (#14534)
17a1f0d2d407040ee242e18dd79be8bb212cfcef	8f22dc0a53338c629c1ef8fa878d8e39bfe627c9	2025-07-08T11:47:33+03:00	Alawode Oluwandabira		server: Add ability to mount server at prefix (#14544)
ddef99522d1ba74193b7394e803fab8db5c78bae	668168814601d2aef6161ce49ab186bc74177ae7	2025-07-05T09:17:14+02:00	Sigbjørn Skjæret		server : fix assistant prefilling when content is an array (#14360)
a70c8a0c4b4c1606cd9a0ba889ce61aa88610095	9067487c4411efb20400103fcccfdd389c80d428	2025-07-03T10:53:35+03:00	Georgi Gerganov		kv-cache : use ggml_set_rows (#14285)
c839a2da1a0d4275c3a98f70c3a7627487573a46	e9b6350e61d592634263a14b3d77ecbf6c1fb096	2025-06-30T17:48:24+08:00	xiaobing318		cmake : Remove redundant include path in CMakeLists.txt (#14452)
caf5681fcb47dfe9bafee94ef9aa8f669ac986c7	83790b0e7e09ab17238b16452a33053a71dbdfad	2025-06-29T20:02:53+02:00	matteo		server : support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client (#13196)
83790b0e7e09ab17238b16452a33053a71dbdfad	f47c1d7106e49062279bcc57fc1077c0db61e278	2025-06-29T19:29:57+02:00	Renat		server : fix appearance of the chats list context menu for Safari (#14322)
bd9c981d7226107f18deb8344c3301450311bb8b	27208bf657cfe7262791df473927225e48efe482	2025-06-29T02:43:36-05:00	Jeff Bolz		vulkan: Add fusion support for RMS_NORM+MUL (#14366)
8f52c6f8abb2ed9ad967cc0bfb90acb073011193	d2f325130c4ed77a3dcff2c23a926587fb08e2cc	2025-06-26T15:10:45+08:00	Yunzhe Jia		Squashed commit of the following:
1b809cee225222094a0ff5be8467240487ce4ae4	abf241045d09cad70dc797b0fba393ad09ee2cbe	2025-06-24T08:59:11Z	Nigel Bosch		server : move no API key doc to /health (#14352)
901e20bbe571fbde48d13eb188f4e7cdc7562fb6	0142961a2e67909e33cdf410274b56c08c5dce7a	2025-06-24T02:17:58-04:00	Bartowski		jinja : Add Mistral-Small-3.2-24B-Instruct-2506.jinja (#14349)
8308f98c7fb778e54bf75538f5234d8bd20915e9	6369be07359d03723f38c0a4a014ff0f698a0738	2025-06-20T15:07:21+02:00	Nicolò Scipione		sycl: add usage of enqueue_functions extension (#14244)
d67341dc18fc5cc63362880ab2f8f9ecfc7932e7	456af35eb70177b8dd5779b6d4c21bb020f9cebd	2025-06-19T16:01:03+03:00	aa956		server : add server parameters for draft model cache type (#13782)
edc4a29effe716956fdfd2bc5b9cba2a6d8492f8	ed3290ab34493fd3d2e0f925f816a401da4f2dfd	2025-06-19T00:08:14-05:00	Gabe Goodhart		memory : Hybrid recurrent cache (#13979)
89fea80d298184d1cd93564f48e060d9f541f4b4	6adc3c3ebc029af058ac950a8e2a825fdf18ecc6	2025-06-16T22:33:27+03:00	Georgi Gerganov		server : fix incorrect usage of llama_get_embeddings() (#14225)
d3e64b9f490cee41b7b9aa275dae2f6568ae3054	3ba0d843c6bd3faea5cf5e53dc7f3c82be20bffb	2025-06-16T14:14:00+03:00	Georgi Gerganov		llama : rework embeddings logic (#14208)
cd355eda7df1898d25d433b4bdaa4b4b479e0bad	30e5b01de2a0bcddc7c063c8ef0802703a958417	2025-06-15T23:36:22+02:00	Eric Curtin		server : When listening on a unix domain socket don't print http:// and port (#14180)
c311ac664d68d10781a3e7b9f02d9d9520837d80	b9912ac570de8945ae9383c9ca8291027bf287dd	2025-06-15T10:08:58+03:00	Georgi Gerganov		cparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188)
3cb203c89f60483e349f841684173446ed23c28f	2e42be42bd6bf1dcc643d6ac4e77419bfe5dd24f	2025-06-14T18:25:15+02:00	Piotr		llama-chat : Do not throw when tool parsing fails (#14012)
ffad04397399ea1650fda6560c7c753059804876	0889eba570126f8a2f5a0e88fde776bbc91cca66	2025-06-13T11:18:25+03:00	Georgi Gerganov		server : fix SWA condition for full context reprocess (#14163)
c61285e7396c8e526fe7794c19e8d4f1c99bfc51	09cf2c7c655c90e53e100f29b830a788bab0653d	2025-06-13T08:45:37+01:00	Ewan Crawford		SYCL: Bump oneMath commit (#14152)
7d516443dd7766569110b38e6374649bee6eb1c4	f6e1a7aa8787b5c00acba6370cb70a0beff48b1e	2025-06-12T11:51:38+03:00	Georgi Gerganov		server : re-enable SWA speculative decoding (#14131)
2baf07727f921d9a4a1b63a2eff941e95d0488ed	7ae2932116a4de3141cbc8c488f7f6e4e06d8171	2025-06-11T06:43:43-04:00	Taylor		server : pass default --keep argument (#14120)
1f7d50b2936023b26eb218e944e62834b80a2ce0	4c763c8d1b4d4de20bf364ec1837430783cba984	2025-06-11T00:19:25-05:00	Jeff Bolz		vulkan: Track descriptor pools/sets per-context (#14109)
dad5c44398b78467943ed0a603ea427fe9f6fc62	55f6b9fa6563f6ae49113f9abdc980c12348cc1c	2025-06-10T18:20:14-04:00	compilade		kv-cache : avoid modifying recurrent cells when setting inputs (#13834)
2bb0467043258bdc58dbaefb33786f1731b38937	b8e2194efc529378be45ab9b27d6648a5b81458a	2025-06-10T02:41:01-04:00	Isaac McFadyen		rpc : nicer error messages for RPC server crash (#14076)
87d34b381d5868e75586210ec17b5ef5deddc276	b460d16ae858c6624fd37aec316622a4060ca325	2025-06-09T12:57:58+03:00	Georgi Gerganov		server : fix LRU check (#14079)
228f34c9ceefa3ea4f4d6933edd858121e8106cb	0974ad7a7cd4bca846b15c484ff3be890135a52c	2025-06-07T18:58:20+05:30	Akarshan Biswas		SYCL: Implement few same quantized type copy kernels (#13739)
745aa5319b9930068aff5e87cf5e9eef7227339b	487a5e0401423bba02cd6e97e4d45131bb20b22b	2025-06-06T14:11:15+03:00	Georgi Gerganov		llama : deprecate llama_kv_self_ API (#14030)
7f37b6cf1e2c1b90bf0d9c8d91904b4b6c512748	3a077146a4761fdbd24bdd8eb098f46b8adc4dda	2025-06-05T15:29:22+03:00	Georgi Gerganov		memory : migrate from llama_kv_cache to more generic llama_memory (#14006)
363757628848a27a435bbf22ff9476e9aeda5f40	ea394d7ab1f8101716d48ce9421c94c71b93a00f	2025-06-02T21:34:40+03:00	Georgi Gerganov		server : disable speculative decoding for SWA models (#13970)
c9bbc77931d223ed7e7cbcf1cb057bc02fd0db19	bfd322796cd838f906535ff3352624fc46338894	2025-06-02T10:15:44-07:00	Olivier Chafik		`server`: update deepseek reasoning format (pass reasoning_content as diffs) (#13933)
c04621711a893cbd09cff6c927cb005bc6749e36	0fc16b42e8793364918e830c234c1f3caec29dae	2025-06-01T11:42:16+03:00	Georgi Gerganov		parallel : fix n_junk == 0 (#13952)
e15898d1c7e87f1b3d14e0a3c385eeb424b085fe	803f8baf4f741d2f0465c46c33f285886b97a071	2025-05-31T08:26:10-07:00	Olivier Chafik		server: allow unclosed thinking tags (#13931)
12d0188c0dc6146ffde6d277a93f232ccbe699f8	eb3949938e82a128855bc0676220bb2ce6e4228d	2025-05-31T10:24:04+03:00	Georgi Gerganov		kv-cache : refactor + add llama_memory_state_i (#13746)
dd665cc9d4b378626cde11ea0c4c91f514fdc994	df0c0c7d02f951dc639d48fd536f79200460ac83	2025-05-30T19:38:07+03:00	Georgi Gerganov		parallel : increase the variability of the prompt lengths (#13927)
53f925074de02c5304b00c14b4d6d8910c58667d	db38704f0133be7832123495fa8fc2601ea999d4	2025-05-30T16:25:45+03:00	Georgi Gerganov		sync : vendor (#13901)
10961339b26bd2eff01d5479e8879f435da261b7	d98f2a35fcf4a8d3e660ad48cd19e2a1f3d5b2ef	2025-05-28T22:35:22+02:00	Xuan-Son Nguyen		mtmd : move helpers to dedicated library (⚠️ breaking change) (#13866)
c962ae3382a1e759c8517a229549ee53685313a1	a3938fb53d0b5183db4f5a6db21fd9122a0e4780	2025-05-28T22:33:54+08:00	Sky		server: fix remove 'image_url'/'input_audio' json-object effectlly for 'llama_params' in multimodal-model-mode (#13853)
952f3953c1b61cc70e79e536c42ddce6a5ea5ea7	81713121ee56755ba4a147d1a1e3fa248ec31a66	2025-05-27T04:05:18-07:00	Diego Devesa		ggml : allow CUDA graphs when using pipeline parallelism (#13814)
cdf94a18023c92f41808ec874ba577d914674717	a26c4cc11ec7c6574e3691e90ecdbd67deeea35b	2025-05-26T14:34:27-07:00	Olivier Chafik		server: --offline mode (#13804)
03f582ae8fccecff225c30a2802461b44761e822	88c125f2acce0e25e5fc8481ab0681415fc64a10	2025-05-26T08:03:57-07:00	Olivier Chafik		server: fix streaming crashes (#13786)
d74e94c1b3ac02db01e47008e1f8d371029d81ac	f13847cfb560d92492b480cca2c5d6aa9473cde3	2025-05-26T06:56:49-07:00	Olivier Chafik		`server`: fix format of streamed tool call deltas (diff name, fix id location) (#13800)
f13847cfb560d92492b480cca2c5d6aa9473cde3	79c137f77677b3c8ee3c60a7da033721b938399a	2025-05-26T06:16:37-07:00	Olivier Chafik		server: fix regression on streamed non-chat completion w/ stops (#13785)
e121edc4324a640be11b7e567edd39b721b0f8e4	2f099b510f460374acd52742b494595e3e3442d3	2025-05-26T00:30:51+01:00	Olivier Chafik		`server`: add `--reasoning-budget 0` to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771)
de2ef53a4b2c0d703749a309d19fe68fd8f1b9ac	c508256db2de2b032e19c8ed833f4683c827c9a1	2025-05-25T16:34:36+03:00	Georgi Gerganov		kv-cache : rework kv_cell (#13706)
d785f9c1fd1a1929c6d0e2a0b12cae5db867908b	4032ca406632212b075e3c61c2a4476128321410	2025-05-25T10:45:49+01:00	Olivier Chafik		server: fix/test add_generation_prompt (#13770)
f5cd27b71da3ac375a04a41643d14fc779a8057b	a2d02d5793fd9af7a7224773456501691b95fd02	2025-05-25T01:48:08+01:00	Olivier Chafik		`server`: streaming of tool calls and thoughts when `--jinja` is on (#12379)
9ecf3e66a38f20e41d221f62f05b17f70d040839	faaaff5f947064d13ef8b98659d81a1384c3e57b	2025-05-23T11:03:47+02:00	Xuan-Son Nguyen		server : support audio input (#13714)
797990c4bca0dca5be295c63e3fb2800dc0a69c2	ab86335760ebb441574eb47f886fa1ee302e2131	2025-05-22T20:42:48+02:00	Xuan-Son Nguyen		mtmd : add ultravox audio input (#13623)
cc74d5be990e37f201591fd868a92e64abdbf902	5be24af73d77ea23d399726f1d2a01a70ee86331	2025-05-22T16:33:39+03:00	Georgi Gerganov		server : pad small embedding batches (#13692)
5fbfe384d4659f81c47a477eb8ee97692c7ffef9	c76532e7ba128bb097bf6836bf0f5592e1b56b76	2025-05-21T19:46:56+03:00	Georgi Gerganov		server : improve error reporting (#13680)
c76532e7ba128bb097bf6836bf0f5592e1b56b76	2aa777d86d3f7bb80b93e226f1c25e47825f6a83	2025-05-21T19:40:35+03:00	antichristHater		convert : add qwen2vl support for unsloth merges (#13686)
0d5c74216170ef97e5e7511563837263f2d1a496	42158ae2e8ead667a83f07247321ce85f32ace66	2025-05-21T15:15:27+02:00	Robin Davidsson		server : Add the endpoints /api/tags and /api/chat (#13659)
42158ae2e8ead667a83f07247321ce85f32ace66	797f2ac0625b22edeff03cc30e0f988da6b6b068	2025-05-21T16:07:57+03:00	Dorin-Andrei Geman		server : fix first message identification (#13634)
a4090d1174aed22dde5cacce2a4c27656b987a2f	b69f1647f9953cb3773266d2c83a92fd0e7e6d66	2025-05-20T16:13:16+03:00	Georgi Gerganov		llama : remove llama_kv_cache_view API + remove deprecated (#13653)
e298d2fbd082a52c0f6ed02729f94e9bf630cf17	f0adb80bf7c2c0d80abb04f4533b5513622d9964	2025-05-20T08:05:46+03:00	Georgi Gerganov		kv-cache : add SWA support (#13194)
f71f40a2847d4c9f57b86cd206e0a27b2bfb6d1c	d30cb5a7fa17362c47e94a023276f169916e0d03	2025-05-19T11:46:09+01:00	Alberto Cabrera Pérez		ci : upgraded oneAPI version in SYCL workflows and dockerfile (#13532)
6a2bc8bfb7cd502e5ebc72e36c97a6f848c21c2c	e3a7cf6c5bf6a0a24217f88607b06e4405a2b5d9	2025-05-17T17:59:48-04:00	Isaac McFadyen		server : added --no-prefill-assistant flag (#13608)
518329b2d4434d0683c30b741b4f4cf5734b5f99	2f5a4e1e09567e09be8b84a5f976334de9539d17	2025-05-17T12:58:55+03:00	Georgi Gerganov		parallel : add option for non-shared and larger prompts (#13598)
6aa892ec2aa7fe0c93e87c4b970d83a942fb9454	aea9f8b4e73876739bf88fb705502f291294e469	2025-05-16T21:50:00+02:00	Xuan-Son Nguyen		server : do not return error out of context (with ctx shift disabled) (#13577)
3cc1f1f1d24472a6558c942b1c78989ff4b0e569	c753d7bed0dc2cc2d5c42dfa9806cba91748392e	2025-05-15T14:24:50+02:00	Xuan-Son Nguyen		webui : handle PDF input (as text or image) + convert pasted long content to file (#13562)
c753d7bed0dc2cc2d5c42dfa9806cba91748392e	b2838049ccf50859cea4c390e81405c2fb01e820	2025-05-15T08:40:58+02:00	Piotr Wilkin (ilintar)		server : proper error handling for missing elements in messages array (OpenAI compatible backend) (#13540)
aa48e373f256df9608395ee6881e7010840d6202	e3a9421b78da5c810d812e6348a405f5acc39f34	2025-05-15T02:39:51+01:00	Olivier Chafik		`server`: inject date_string in llama 3.x template + fix date for firefunction v2 (#12802)
053174436f3b3cbb01077f26ff17809537b832c7	360a9c98e13d35f322b4c5b1309aab0cc90ed82b	2025-05-14T15:42:10+03:00	Georgi Gerganov		server : passthrough the /models endpoint during loading (#13535)
360a9c98e13d35f322b4c5b1309aab0cc90ed82b	09d13d94fb169093095416ac6323551c37b75339	2025-05-14T13:35:07+02:00	Xuan-Son Nguyen		server : fix cache_tokens bug with no cache_prompt (#13533)
d486dd3e8ecfba0170f8632a1530540de560f4a3	21ca987fba504d273ea28ebc4d3e5b3736a11c8e	2025-05-14T10:07:31+02:00	Luca Stefani		webui: Allow pasting file from clipboard (#13526)
71bdbdb58757d508557e6d8b387f666cdfb25c5e	f0995d28ce3d15095b6845d94ce4465e46575873	2025-05-13T17:07:21+02:00	Xuan-Son Nguyen		clip : clip.h become private API (⚠️ breaking change) (#13510)
91159ee9df84edb72ccf874e353d2414f3a8c60d	22cdab343b63edd0906f1c132616746085f81983	2025-05-12T18:56:42+07:00	Anudit Nagar		server : allow content to be null in oaicompat_completion_params_parse (#13477)
9a390c4829cd3058d26a2e2c09d16e3fd12bf1b1	09232370fc6426aa5dd9be01a8271b9c28f5af3a	2025-05-11T11:08:26-04:00	Anthony Umfer		tools : fix uninitialized llama_batch in server (#13436)
3b24d26c22b9d92b5aa39930988700c84e524cf4	43dfd741a5da77982e0a94d1e522a2481dfb914d	2025-05-10T18:44:49+02:00	Xuan-Son Nguyen		server : update docs (#13432)
33eff4024084d1f0c8441b79f7208a52fad79858	17512a94d636c4b6c1332370acb3e5af3ca70918	2025-05-09T19:29:37+02:00	Xuan-Son Nguyen		 server : vision support via libmtmd (#12898)
b486ba05bf973aae3652b3fd593e0b257d3a41d4	02115dcd9a6d0c03b527d5bee8c1493ab819ddbd	2025-05-09T10:31:07+03:00	Radoslav Gerganov		rpc : add rpc_msg_set_tensor_hash_req (#13353)
d9c4accaff30926e8a5fd8a2429e549158a845e0	15e03282bb432631193464100c2237a3b6bcfe4c	2025-05-09T09:06:37+02:00	Xuan-Son Nguyen		server : (webui) rename has_multimodal --> modalities (#13393)
ee01d71e585f4a17ae83ec55d77acfdcf0bfa798	8c83449cb780c201839653812681c3a4cf17feed	2025-05-08T18:51:45+02:00	Xuan-Son Nguyen		server : (webui) fix a very small misalignment (#13387)
8c83449cb780c201839653812681c3a4cf17feed	1a844be132dbe865358e1de81136920c1d35ac73	2025-05-08T15:37:29+02:00	Xuan-Son Nguyen		server : (webui) revamp the input area, plus many small UI improvements (#13365)
233461f8121455f957a47e6a22a77b3bc88277b0	b34c859146630dff136943abc9852ca173a7c9d6	2025-05-05T17:12:19-03:00	oobabooga		sampling : Integrate Top-nσ into main sampling chain (and add it to the server) (#13264)
b34c859146630dff136943abc9852ca173a7c9d6	9b61acf06041dcbaff6afa5f28940e93297f8520	2025-05-05T17:03:31+03:00	igardev		server : Webui - change setText command from parent window to also send the message. (#13309)
27aa2595321c4d9cc4086a8e67bdea204b8309b0	9fdfcdaeddd1ef57c6d041b89cd8fb7048a0f028	2025-05-04T23:43:42+02:00	Xuan-Son Nguyen		mtmd : add C public API (#13184)
fab647e8842c5f80da7e8f2c625dab6a0e19e5d4	dcf886007de4b8e5200f461a13233315f897fb9d	2025-05-02T09:48:31+03:00	Georgi Gerganov		server : add cache reuse card link to help (#13230)
e2e1ddb93a01ce282e304431b37e60b3cddb6114	d9d398f84f96d16c308d4976f5e90222ecc2a492	2025-04-29T20:33:10+02:00	matteo		server : Prefilling assistant message in openai compatible API (#13174)
43ddab6eeeaab5a04fe5a364af0bafb0e4d35065	1831f538f720d1d99fba146f24f0a8e970838cc4	2025-04-28T21:00:20+03:00	Ville Vesilehto		fix(rpc): Improve input validation and error handling (#13069)
77d5e9a76a7b4a8a7c5bf9cf6ebef91860123cba	d5fe4e81bd447124836ecfb47d794f8768665b9f	2025-04-26T22:05:31+08:00	SXX		ggml: move fp16/bf16 conversion optimizations to CPU backend + export conversion APIs (#13107)
ab47dec3d37aa1927c2ec590e166b76141374ed3	7b53389c24a507564be39e1ea82746a39749059b	2025-04-22T16:16:10+03:00	Georgi Gerganov		security : add note about RPC and server functionality (#13061)
35370ba94593c3abc9550328377d461fc4f822b7	8d6600576318dfc6b091fca744b0fd36a5e5255f	2025-04-18T19:58:12+02:00	Xuan-Son Nguyen		server : use std::move whenever possible (#12936)
b9154ecff93ff54dc554411eb844a2a654be49f2	2db9ba1464f3de0aceb2b5289963e69fc369cb66	2025-04-18T10:04:51+02:00	Xuan-Son Nguyen		mtmd : add methods to access `mtmd_image_tokens` (#12906)
2db9ba1464f3de0aceb2b5289963e69fc369cb66	2f74c354c0f752ed9aabf7d3a350e6edebd7e744	2025-04-18T10:13:42+03:00	Radoslav Gerganov		rpc : add RPC_CMD_HELLO (#12955)
c94085df2871d2cad11f6411304d7798d7dd4cdd	e8a62631b3b05bcf2ad0e0c686881a9f3e3f03ca	2025-04-11T23:37:41+03:00	Georgi Gerganov		server : add VSCode's Github Copilot Chat support (#12896)
e8a62631b3b05bcf2ad0e0c686881a9f3e3f03ca	b6930ebc421e20399663bbd3bc7b7266d5236d06	2025-04-11T13:04:14-07:00	yuri@FreeBSD		rpc : Set cache directory in rpc-server.cpp on FreeBSD (#12903)
578754b3157d662c2fdd51eaa62b6c1f43d3172c	b2034c2b55b36b2192bdefb3b295db2a911370f5	2025-04-11T15:32:14+02:00	Ewan Crawford		sycl: Support sycl_ext_oneapi_limited_graph (#12873)
8b9cc7cdd8a0dcf0176c60c755322c95b5965299	64eda5deb9859e87a020e56bab5d2f9ca956f1de	2025-04-10T22:57:16+02:00	Xuan-Son Nguyen		llava : introduce libmtmd (#12849)
64eda5deb9859e87a020e56bab5d2f9ca956f1de	fe5b78c89670b2f37ecb216306bed3e677b49d9f	2025-04-10T17:24:44+02:00	Xuan-Son Nguyen		convert : ability to lazy-load safetensors remotely without downloading to disk (#12820)
a19b5cef16d885c44c635da4a5c97113c1577de8	78a1ba0a4f2bfed5b8b8e312592143d22e531698	2025-04-08T19:54:51+03:00	Georgi Gerganov		llama : fix FA when KV cache is not used (i.e. embeddings) (#12825)
78a1ba0a4f2bfed5b8b8e312592143d22e531698	2dabf759e7c8c827d38cdd18d0792070e6a4f4e1	2025-04-08T18:37:06+02:00	Xuan-Son Nguyen		server : fix thread.join() on exit (#12831)
8ca6e1c3a4deb6bb27ee294bfd5706098d94ae88	656babd6c21a3b9b3622324cfcc80a2ab78da25b	2025-04-08T14:14:59+05:00	characharm		server : webui : Improve Chat Input with Auto-Sizing Textarea (#12785)
b7723942970b70412793f1926a35cfb93d5c157c	23106f94ea2bc3da929afb7330655fd5515d08dc	2025-04-04T09:09:52-05:00	Nauful Shaikh		server : webui : Upgrade daisyui, tailwindcss. (#12735)
a10b36c91a091f4606710fba4e9327fd71e0e738	83a88bd6affbe148a622ac730952ac5b8b585979	2025-04-02T14:32:59+03:00	Georgi Gerganov		llama : refactor kv cache guard (#12695)
3891e183c61c1e25c2c61afe68d7b95019ea3f89	af6ae1efb27a9a7c3f7f7f84639d2243f7303ac1	2025-03-20T07:02:18+01:00	Daniel Bevenius		examples : command.wasm updates (whisper/2904)
5d01670266859444366e4f333ade5e0e5e2ae63d	ef03229ff423dd1991f4f44ef1352f03334d86eb	2025-03-28T01:05:44-07:00	Benson Wong		server : include speculative decoding stats when timings_per_token is enabled (#12603)
2099a9d5dbdcd2841d02dd396a71d0de70bf4490	296901983700f3c37449bcb555d85d27150a679d	2025-03-27T23:41:04+01:00	Piotr		server : Support listening on a unix socket (#12613)
77f9c6bbe55fccd9ea567794024cb80943947901	18b663d8e4ef352a9a15ff15d695fc3258801d60	2025-03-23T19:30:26+01:00	Marius Gerdes		server : Add verbose output to OAI compatible chat endpoint. (#12246)
517b5ddbf002b91fd6d6daf5d8db8c88a0173039	a9b59288e222f39fc0311dc66944ed5a86c815fa	2025-03-20T01:22:06+05:30	Gaurav Garg		CUDA: Improve flash decoding kernel GPU occupancy for BS=1 case (#12183)
810e0af3f50379682dd46b7967c4aadf3f8286f6	eba92d64c3f6d86de2e6b4dd3a540d2805a22b0c	2025-03-18T12:05:42+02:00	Georgi Gerganov		server : fix warmup draft cache type (#12446)
7dfad387e3f6ac98d383ded2d175eb59736a3993	60c902926c928f9c2cd6390ce411876f92feeaf3	2025-03-18T07:27:50+08:00	Molly Sophia		llama: Add support for RWKV v7 architecture (#12412)
b1b132efcba216c873715c483809730bb253f4a1	01e8f2138b2e40902afe2983ecbf503a08d74b1d	2025-03-17T23:55:13+05:30	Gaurav Garg		cuda : enable CUDA Graph on CUDA Toolkit < 12.x (#12394)
8fcb563613e20a04dd9791f0a9b8a41086428c09	add2a3aa5a1571211aa5c7303b8e80c8d1824b91	2025-03-14T13:47:05+01:00	fairydreaming		Load all MoE experts during warmup (#11571)
add2a3aa5a1571211aa5c7303b8e80c8d1824b91	c522ce4143a2b5c277f1e5f65cd570dbd0626466	2025-03-14T11:21:17+01:00	Victor		server: fix "--grammar-file" parameter (#12285)
2048b5913d51beab82dfe29955f9008130b936c0	f08f4b3187b691bb08a8884ed39ebaa94e956707	2025-03-13T06:10:05-04:00	Ishaan Gandhi		server : fix crash when using verbose output with input tokens that are not in printable range (#12178) (#12338)
4e39a3c332f84b890e91353ec448502cb8373a6f	be421fc429795d135786f5a0e489709220a9c43a	2025-03-10T10:59:03Z	Olivier Chafik		`server`: extract <think> tags from qwq outputs (#12297)
1e2f78a00450593e2dfa458796fcdd9987300dfc	0fd7ca7a210bd4abc995cd728491043491dbdef7	2025-03-09T19:08:20+02:00	Georgi Gerganov		server : add speculative decoding presets for FIM (#12287)
7ab364390f92b0b8d83f69821a536b424838f3f8	7c7f3b7f435f41f2508e0e3010f0013cd8335156	2025-03-07T20:54:30+02:00	Georgi Gerganov		server : infill gen ends on new line (#12254)
8fad3c7a7c54a25a1ca38dfb08244df55288e675	7cf64f6beecf54c6ac71503181f154667fd4228a	2025-03-07T11:15:33+01:00	Sigbjørn Skjæret		server : Log original chat template parsing error (#12233)
06a92a193a07afe445929607be9d5e4d033956fb	a057897ad4e48e3df0354256e0cc80dadcb57595	2025-03-05T15:25:45+08:00	Clauszy		server : fix cache reuse logic (#12161)
1a24c4621f0280306b0d53a4fa474fc65d3f1b2e	becade5de77674696539163dfbaf5c041a1a8e97	2025-03-04T06:24:07Z	Olivier Chafik		`server`: fix deadly typo in response_format.json_schema.schema handling (#12168)
2679c3b55d1c9c3fed56dea00fea713622e42594	c43af9276b119dae7436b7878d59671d0f6b1a97	2025-03-03T16:17:36+01:00	Daniel Bevenius		ci : set GITHUB_ACTION env var for server tests (#12162)
9660ffef582ca275092b621c87085a6eea136a90	c950a1f69269bff416d74349a82d78181ce6f0f8	2025-03-03T20:54:08+08:00	ag2s20150909		ggml : fix kleidiai build (#12159)
70680c48e5f77d2d3138712a6582bd8c1e548922	c43a3e7996e585e2addde1e44057a4f3cdbadef8	2025-02-28T05:41:47-08:00	William Tambellini		ggml : upgrade init_tensor API to return a ggml_status (#11854)
d7cfe1ffe0f435d0048a6058d529daf76e072d9c	a82c9e7c23ef6db48cebfa194dc9cebbc4ac3552	2025-02-25T18:52:56Z	Olivier Chafik		docs: add docs/function-calling.md to lighten server/README.md's plight (#12069)
401af80b546005a06854827b732e3b46979ae028	c132239bfbc1aae3a96dfee3350afcb491f64ade	2025-02-25T11:52:52Z	rhjdvsgsgks		server: handle echo=false on /v1/completions (#12060)
0b52745649062c04b546aab662cfdb220f4f0621	4d1051a40ffc2fdff80bc532eea5b9568b85c156	2025-02-25T10:40:22Z	Olivier Chafik		server: support add_generation_prompt query param (#12062)
3e9a2860e996657fc10db8393cf65adc40703082	58d07a8043a1395177cf77b3e4f388e34182ae64	2025-02-25T01:29:33-08:00	Vitali Lovich		llama : expose llama_model_n_head_kv in the API (#11997)
7a2c913e66353362d7f28d612fd3c9d51a831eda	08d5986290cc42d2c52739e046642b8252f97e4b	2025-02-24T09:09:51-07:00	Alex Brooks		llava : Add Granite Vision Support (#11794)
cf756d6e0a314e0fe25ff944341d79ea8c94cc96	d70908421ff22b013e8209f2d12e5c750663c620	2025-02-22T12:46:31+02:00	Georgi Gerganov		server : disable Nagle's algorithm (#12020)
c392e5094deaf2d1a7c18683214f007fad3fe42b	c5d91a74006c49376590ef2b67420bc7ce206397	2025-02-21T03:43:22+09:00	momonga		server (webui): Fix Premature Submission During IME Conversion (#11971)
d07c621393fab6cf32f3add2aa65e4d5331d4a67	abd4d0bc4f1a9a0e429bc8ee0d5ece2a394a0a39	2025-02-19T12:29:52+01:00	Daniel Bevenius		common : add llama.vim preset for Qwen2.5 Coder (#11945)
b58934c1836b5ea51dbacbe899eee125775e77c9	63e489c025d61c7ca5ec06c5d10f36e2b76aaa1d	2025-02-19T00:01:44+02:00	igardev		server : (webui) Enable communication with parent html (if webui is in iframe) (#11940)
63e489c025d61c7ca5ec06c5d10f36e2b76aaa1d	63ac12856303108ee46635e6c9e751f81415ee64	2025-02-18T18:03:23Z	Olivier Chafik		tool-call: refactor common chat / tool-call api (+ tests / fixes) (#11900)
63ac12856303108ee46635e6c9e751f81415ee64	5137da7b8c3eaa090476a632888ca178ba109f8a	2025-02-18T14:21:41+01:00	Xuan-Son Nguyen		server : add TEI API format for /rerank endpoint (#11942)
09aaf4f1f5b69b5173b7fcd24eab96729f6b242a	73e2ed3ce3492d3ed70193dd09ae8aa44779651d	2025-02-18T17:12:49+08:00	xiaobing318		docs : Fix duplicated file extension in test command (#11935)
c4d29baf3236b011730b6ccaae6852e781fb1b91	2eea03d86a2d132c8245468c26290ce07a27a8e8	2025-02-17T11:25:12+01:00	Antoine Viallon		server : fix divide-by-zero in metrics reporting (#11915)
0f2bbe656473177538956d22b6842bcaa0449fab	fe163d5bf3fb8e99c96ff6d21775fa3d1daee3cf	2025-02-16T18:11:22+01:00	Xuan-Son Nguyen		server : bump httplib to 0.19.0 (#11908)
f3552296924e704c11ca936907b9cad7873db8e2	fc1b0d0936e4dfc52a81f38e7420c7d23f6caa88	2025-02-15T10:11:36Z	Olivier Chafik		server: fix type promotion typo causing crashes w/ --jinja w/o tools  (#11880)
c1f958c0381e797135b7d42a677542133264193c	c48f630d1c1942fce08aa7cb18a53ace443cd611	2025-02-13T17:22:44+01:00	Reza Rahemtola		server : (docs) Update wrong tool calling example (#11809)
c48f630d1c1942fce08aa7cb18a53ace443cd611	bd6e55bfd3f3af3e5705cf87a10e5178cef7c3c1	2025-02-13T14:46:59+01:00	Daniel Bevenius		llama : add --completion-bash option (#11846)
c7f460ab882065ec5696e3d51e24dbf67b539287	27e8a23300e30cd6ff6107ce262acf832ca60597	2025-02-13T10:05:16Z	Olivier Chafik		`server`: fix tool-call of DeepSeek R1 Qwen, return reasoning_content (Command 7RB & DeepSeek R1) unless `--reasoning-format none` (#11607)
e4376270d971cff7992bdb6c5412a739195b1459	3e693197724c31d53a9b69018c2f1bd0b93ebab2	2025-02-13T01:25:34-05:00	Oleksandr Kuvshynov		llama.cpp: fix warning message (#11839)
a394039db004c6ee00098250d160b5aa018c2314	be3bbd62153820ff6d358c817360927f429105c4	2025-02-13T01:02:38+01:00	Diego Devesa		ggml-cpu : add chunking support to mul_mat_id (#11666)
31afcbee0eebbc998ab311aa314e389d60aa2127	5c4284d57bbc613121e90de5271f1cbc95d55872	2025-02-12T22:47:11Z	Woof Dog		server : (webui) Give copy button back to all message bubbles (#11814)
a18f481f99962638092d6f1c98b1d34d3e3256de	b9ab0a4d0b2ed19effec130921d05fb5c30b68c5	2025-02-11T14:06:45+01:00	Daniel Bevenius		server : use common_token_to_piece instead of common_detokenize (#11740)
507f9174fe856772b6c7c17e81be442de7ee6d1e	19b392d58dc08c366d0b29bd3b9c6991fa4e1662	2025-02-10T21:23:17+01:00	Xuan-Son Nguyen		server : (webui) introduce conversation branching + idb storage (#11792)
0893e0114e934bdd0eba0ff69d9ef8c59343cbc3	d7b31a9d84297b493a61c9a8ee3a458e7ccc64a7	2025-02-10T18:03:28+01:00	Xuan-Son Nguyen		server : correct signal handler (#11795)
55ac8c7791ff44aeb82bd7fe3ca2041844fc77f1	e6e658319952f7ad269dc11275b9edddc721fc6d	2025-02-08T21:54:50+01:00	Xuan-Son Nguyen		server : (webui) revamp Settings dialog, add Pyodide interpreter (#11759)
e6e658319952f7ad269dc11275b9edddc721fc6d	aaa55053076f3d5d7da4d9a877cb77e112dabed4	2025-02-08T19:09:55Z	Woof Dog		server : (webui) increase edit textarea size (#11763)
aaa55053076f3d5d7da4d9a877cb77e112dabed4	bdcf8b6a56f4d49d3420ae5b21cdf9a116040551	2025-02-08T18:08:43+02:00	Georgi Gerganov		server : minor log updates (#11760)
0cf867160ca9d492e06c0bc688b337cffd1eb187	d2fe216fb2fb7ca8627618c9ea3a2e7886325780	2025-02-08T10:42:34+01:00	Xuan-Son Nguyen		server : (webui) fix numeric settings being saved as string (#11739)
2d219b389e8c8c40bce547b08c8aa7add60fde1f	333820d7491cd31c707a340ff23b984a84e40154	2025-02-07T08:55:47-05:00	Christian Fillion		vocab : ignore invalid UTF-8 input in the BPE tokenizer (#11729)
7ee953a64a40c09438b2064539becdbc577cefd0	ec3bc8270bc67b58955748d40a3e558a05b2d8f2	2025-02-07T04:33:27-05:00	Christian Fillion		llama : add llama_sampler_init for safe usage of llama_sampler_free (#11727)
b7552cfcbc7defccd8bdefd0a7b9c47d145ed3d7	225bbbfa39930cda38a2e5d1f3e5b38226732009	2025-02-07T09:15:22+01:00	Daniel Bevenius		common : add default embeddings presets (#11677)
1d20e53c40c3cc848ba2b95f5bf7c075eeec8b19	2fb3c32a1634488a5265d1304ab37628eeb5480d	2025-02-06T09:29:13-05:00	Patrick Peng		rpc: fix known RCE in rpc-server (ggml/1103)
2fb3c32a1634488a5265d1304ab37628eeb5480d	9ab42dc722ad19a12af80f38a06474d498f96da3	2025-02-06T17:32:29+01:00	Xuan-Son Nguyen		server : (webui) migrate project to ReactJS with typescript (#11688)
902368a06b915b860236cfc97ff885b2aceae256	c3db0480bb820e120249014b380e1f4badf2a1c1	2025-02-05T19:52:31-06:00	Charles Duffy		metal : avoid breaking build when metal API predates TARGET_OS_VISION (#11690)
3962fc1a7956dd0afacfbce10fd1a3ffd3ad857e	1bef571f6a23c36a26dabacba631763f9a893b83	2025-02-04T18:25:42+01:00	Xuan-Son Nguyen		server : add try..catch to places not covered by set_exception_handler (#11620)
db288b60cb49eab69703f995379b8d75c18bf5b3	106045e7bb8db481bb2ebbc60e3b53cb27ada117	2025-02-04T15:48:53Z	Olivier Chafik		`tool-call`: command r7b fix for normal responses (#11608)
f117d84b48104992ba16961b35a96fa93efbb355	534c46b53c23613628d72e93c63ea01ea4d1e2ac	2025-02-04T19:15:24+08:00	Jhen-Jie Hong		swift : fix llama-vocab api usage (#11645)
b3451785aca16fbf4214eeba7e4612676cdf8ccb	1d1e6a90bcf485ad2dee309c31cf19bd802465e5	2025-02-04T00:10:52+01:00	Xuan-Son Nguyen		server : (webui) revert hacky solution from #11626 (#11634)
1d1e6a90bcf485ad2dee309c31cf19bd802465e5	5598f475be3e31430fbe17ebb85654ec90dc201e	2025-02-03T22:16:27Z	Woof Dog		server : (webui) allow typing and submitting during llm response (#11626)
5598f475be3e31430fbe17ebb85654ec90dc201e	8ec05832fa8409c49b3bbd13f957c6ae8486e618	2025-02-03T16:45:38+01:00	Daniel Bevenius		server : remove CPPHTTPLIB_NO_EXCEPTIONS define (#11622)
d92cb67e37abc23b1c6f7b0ef27a9889da8537e3	6eecde3cc8fda44da7794042e3668de4af3c32c6	2025-02-03T09:42:55Z	mashdragon		server : (webui) Fix Shift+Enter handling (#11609)
bfcce4d693617ec843d0b2510f6ee16e6bc6720d	69804487e0b10f2c5c06316f0ac0eb6ada68433f	2025-02-02T09:25:38Z	Olivier Chafik		`tool-call`: support Command R7B (+ return tool_plan "thoughts" in API) (#11585)
ff227703d6d6e1888bdc7af6138514092ffcdb96	0cec062a638700495673f5494d200b74340538be	2025-02-01T23:55:32-08:00	Michał Moskal		sampling : support for llguidance grammars (#10224)
a83f528688324a21484a97af1d1be5e1bc8d4c8e	b1bcd309fc8ac929cbd4a6207b3a19886bda031f	2025-01-31T14:15:25Z	Olivier Chafik		`tool-call`: fix llama 3.x and functionary 3.2, play nice w/ pydantic_ai package, update readme (#11539)
4a2b196d03d52da31236390e9f5694a88d43d11d	1bd3047a939e561adfb3c7dd2e17c4cc7a4e4e6f	2025-01-31T08:12:40Z	Olivier Chafik		server : fix --jinja when there's no tools or schema (typo was forcing JSON) (#11531)
a2df2787b32e0846205f7151dfad88ceab592beb	553f1e46e9e864514bbd6bf4009146db66be0541	2025-01-31T06:04:53+01:00	Daniel Bevenius		server : update help metrics processing/deferred (#11512)
4314e56c4f8c5091f45732f39bd94c0c6c323798	496e5bf46bab757d05e18227cb4e17055ae42f42	2025-01-30T11:05:00+01:00	Daniel Bevenius		server : use lambda instead of std::bind (#11507)
496e5bf46bab757d05e18227cb4e17055ae42f42	7919256c57f05c09b0b50ec9abb37ff62dab7251	2025-01-30T04:11:53-05:00	Isaac McFadyen		server : (docs) added response format for /apply-template [no ci] (#11503)
e0449763a4f335cca374254a72892141f41eaa59	eb7cf15a808d4d7a71eef89cc6a9b96fe82989dc	2025-01-30T05:48:14+01:00	Daniel Bevenius		server : update json snippets in README.md [no ci] (#11492)
eb7cf15a808d4d7a71eef89cc6a9b96fe82989dc	66ee4f297cff3c7ce98b31dbc0ce909d41b9e408	2025-01-29T12:45:44-06:00	Nigel Bosch		server : add /apply-template endpoint for additional use cases of Minja functionality (#11489)
e51c47b401f8cb5f21630a05171e2529cde4d186	2711d0215ff6a1ecb2202ac8c1f135bceed7057b	2025-01-29T16:34:18+01:00	Daniel Bevenius		server : update auto gen files comments [no ci] (#11484)
cf8cc856d7d02165bd08593b4757e1256a62d501	d0c08040b6c8bebeade7b8d5764df6cf901678d5	2025-01-28T16:03:42-07:00	peidaqi		server : Fixed wrong function name in llamacpp server unit test (#11473)
49b0e3cec4b67dc9f4debe3a16acd4c819f751d6	20a758155bc5f37290b20ea44d76ba99c4e7f2cb	2025-01-25T16:36:44+01:00	Xuan Son Nguyen		server : fix cleaning up stream task (#11418)
c07e87f38bd0c22ec6dbc852ae50aaa1c64632d4	564804b79b78df1469ec8646869972de5e885ec4	2025-01-24T09:02:38+01:00	stduhpf		server : (webui) put DeepSeek R1 CoT in a collapsible <details> element (#11364)
58456616408c828a1ce6d2481940fd1c97bce3b5	f211d1dc10332b7e89a4abd1041903fa63bfed27	2025-01-23T13:56:05+01:00	Xuan Son Nguyen		server : add more clean up when cancel_tasks is called (#11340)
12c2bdf2de34f747d13b270fc9d3b52490bf194f	c64d2becb13f2a7c0145b516a05f028d949a046b	2025-01-22T17:44:40+01:00	Diego Devesa		server : fix draft context not being released (#11354)
6171c9d25820ccf676b243c172868819d882848f	e28245f35f2faaf249dd352998b3693a8cc28c51	2025-01-21T13:18:51Z	Olivier Chafik		Add Jinja template support (#11016)
f30f099228f774209aa3010b78dfbe5d262e69aa	f26c87417999209e7f4576b4f3ecf7a5b9c66a29	2025-01-18T14:12:05+01:00	Xuan Son Nguyen		server : implement cancellable request (#11285)
0ccd7f3eb2debe477ffe3c44d5353cc388c9418d	f446c2cf6a56a750b67c967505e717a996d2f2fd	2025-01-15T05:44:38+01:00	Daniel Bevenius		examples : add embd_to_audio to tts-outetts.py [no ci] (#11235)
c5bf0d1bd7eb8762edca47e0a95f64e6fbfaf5b1	091592d758cb55af7bfadd6c397f61db387aa8f3	2025-01-14T14:09:33+03:30	ebraminio		server : Improve code snippets direction between RTL text (#11221)
504af20ee4eae72080a56d59d744f6774f7901ce	84a44815f704aaed8e8edec7a39e846a975c7ba9	2025-01-13T22:53:31+03:30	ebraminio		server : (UI) Improve messages bubble shape in RTL (#11220)
437e05f714cdd67757405221578d3f95f8228b63	ca001f6656c1c3d29ef479b3aa5d669453e63be5	2025-01-13T17:16:39+03:30	ebraminio		server : (UI) Support for RTL text as models input or output (#11208)
afa8a9ec9b520137bbd1ca6838cda93ee39baf20	c05e8c9934f94fde49bc1bc9dc51eed282605150	2025-01-12T11:32:42+02:00	Georgi Gerganov		llama : add `llama_vocab`, functions -> methods, naming (#11110)
8eceb888d7b7f5e93d20a4f85ca6511022b87040	f8feb4b01af374ad2fce302fd5790529c615710b	2025-01-09T11:28:29+01:00	Daniel Bevenius		server : add tooltips to settings and themes btn (#11154)
53ff6b9b9fb25ed0ec0a213e05534fe7c3d0040f	017cc5f446863316d05522a87f25ec48713a9492	2025-01-07T18:01:58+01:00	Johannes Gäßler		GGUF: C++ refactor, backend support, misc fixes (#11030)
e6e7c75d94adf4d39e846d30807c531ff22865e7	09186fabbe05236f2b9446ba6c643cb737540d10	2025-01-06T15:36:08+02:00	Georgi Gerganov		server : fix extra BOS in infill endpoint (#11106)
6369f867a410416239d9f20ec27c2b1d6a9fee52	47182dd03fe04a4ffda5d7f4c8a109ae0056cf56	2025-01-06T10:28:17+01:00	Daniel Bevenius		llama : rename missed batch params/vars to ubatch (#10059)
47182dd03fe04a4ffda5d7f4c8a109ae0056cf56	3e6e7a6bc2c4b980a0cf0fcb5cb3b79a965b5f14	2025-01-06T10:55:18+02:00	Georgi Gerganov		llama : update llama_model API names (#11063)
2f0ee84b9b02d2a98742308026f060ebdc2423f1	0da5d860266c6928b8c9408efbd264ae59fedda6	2025-01-02T18:06:12+01:00	Pierrick Hymbert		server: bench: minor fixes (#10765)
0da5d860266c6928b8c9408efbd264ae59fedda6	a45433ba209ee0b33d02c7dc4c31f29894ad83a6	2025-01-02T15:05:18+01:00	Xuan Son Nguyen		server : allow using LoRA adapters per-request (#10994)
45095a61bfd164e87563a0dc0fbd7b0e9891590b	5896c65232c7dc87d78426956b16f63fbf58dcf6	2024-12-31T15:22:01+01:00	Xuan Son Nguyen		server : clean up built-in template detection (#11026)
5896c65232c7dc87d78426956b16f63fbf58dcf6	bc7b1f86324279a3dabb705c04ad754a2b27df16	2024-12-31T12:34:13+01:00	Xuan Son Nguyen		server : add OAI compat for /v1/completions (#10974)
f865ea149d71ef883e3780fced8a20a1464eccf4	16cdce7b68218959e0658e2f95b4572573d5008e	2024-12-28T10:09:19-05:00	Isaac McFadyen		server: added more docs for response_fields field (#10995)
16cdce7b68218959e0658e2f95b4572573d5008e	d79d8f39b4da6deca4aea8bf130c6034c482b320	2024-12-28T15:08:54Z	Alexey Parfenov		server : fix token duplication when streaming with stop strings (#10997)
9ba399dfa7f115effc63d48e6860a94c9faa31b2	2cd43f4900ba0e34124fdcbf02a7f9df25a10a3d	2024-12-24T21:33:04+01:00	Reza Kakhki		server : add support for "encoding_format": "base64" to the */embeddings endpoints (#10967)
09fe2e76137dde850b13313f720e7ffa17efdefa	30caac3a68a54de8396b21e20ba972554c587230	2024-12-24T19:39:49+03:00	NeverLucky		server:  allow filtering llama server response fields (#10940)
14b699ecde8f1e9e251ebff9eca39ebc5603b83b	485dc01214f266afff7004bc702498b491abc404	2024-12-23T12:52:25+01:00	Xuan Son Nguyen		server : fix missing model id in /model endpoint (#10957)
485dc01214f266afff7004bc702498b491abc404	86bf31cfe684849157f0875b4f0ebccac7034547	2024-12-23T12:02:44+01:00	Xuan Son Nguyen		server : add system_fingerprint to chat/completion (#10917)
86bf31cfe684849157f0875b4f0ebccac7034547	b92a14a841fb4dfaf27b29d982ec8ba5289a3bff	2024-12-23T10:39:30+02:00	Radoslav Gerganov		rpc-server : add support for the SYCL backend (#10934)
0ca416c91aea4549d9c77e3efeca403e15aa6c75	21ae3b9be83820565d1a720999b7f63ce95b4920	2024-12-20T14:12:06+01:00	Xuan Son Nguyen		server : (UI) fix copy to clipboard function (#10916)
57bb2c40cd94c5a09f5210ed8264cc93b21c4b7e	a3c33b1dce2d4f25040b75f66629104bd1e40128	2024-12-19T15:40:08+01:00	Xuan Son Nguyen		server : fix logprobs, make it OAI-compatible (#10783)
0bf2d10c5514ff61b99897a4a5054f846e384e1e	7bbb5acf125d1d2840cac7d31b9aaa72210dd5ec	2024-12-18T19:27:21+02:00	Georgi Gerganov		tts : add OuteTTS support (#10784)
7bbb5acf125d1d2840cac7d31b9aaa72210dd5ec	152610eda91217ac409342cd976d05f5114ad39f	2024-12-18T04:00:07-10:00	Gaetan Bisson		server: avoid overwriting Authorization header (#10878)
152610eda91217ac409342cd976d05f5114ad39f	0e70ba686e6c717a0aa41d88284e2a392c2bd0cd	2024-12-18T13:01:41+02:00	Georgi Gerganov		server : output embeddings for all tokens when pooling = none (#10861)
0e70ba686e6c717a0aa41d88284e2a392c2bd0cd	46828872c31b25df16169cbbf5c2225fa9cb0675	2024-12-18T11:05:29+02:00	Georgi Gerganov		server : add "tokens" output (#10853)
46828872c31b25df16169cbbf5c2225fa9cb0675	6b064c92b4c0228e333193c167f2c98d2ec8d9bc	2024-12-18T09:55:09+01:00	Xuan Son Nguyen		server : (embeddings) using same format for "input" and "content" (#10872)
d62b532c52e0118323277eaa5f442e11ce6505ed	081b29bd2a3d91e7772e3910ce223dd63b8d7d26	2024-12-17T17:24:22-05:00	DAN™		Use model->gguf_kv for loading the template instead of using the C API. (#10868)
05c3a444b8b017b01b366b725ba22c740aae6b38	382bc7f2e8ffd0b89f23e840d097e21f301197ba	2024-12-17T16:00:24Z	krystiancha		server : fill usage info in embeddings and rerank responses (#10852)
227d7c5a7f4cc7734fde8a4ef4382d613486d3c8	7b1ec53f56bb72c49e4c8434157895f94d3709c2	2024-12-17T09:52:09+01:00	Xuan Son Nguyen		server : (UI) fix missing async generator on safari (#10857)
5478bbcd173e7027af7689493c7421719f5c43df	b5ae1ddff93403300fc79c7ab5ee73b8cfbb3457	2024-12-15T05:55:54-06:00	Vinesh Janarthanan		server: (UI) add syntax highlighting and latex math rendering (#10808)
89d604f2c87af9db657d8a27a1528bc4b7579c29	e52aba537a34d51a65cddec6bc6dafc9031edc63	2024-12-14T22:29:45Z	Michelle Tan		server: Fix `has_next_line` in JSON response (#10818)
a76c56fa1a3d27467eb97468d8c3b2fe1243b61a	c27ac678dd393af0da9b8acf10266e760c8a0912	2024-12-13T12:23:52-08:00	lhez		Introducing experimental OpenCL backend with support for Qualcomm Adreno GPUs (#10693)
5555c0c1f66d766c544c30699190dec0285bcbfc	973f328b1e92a6406030442dfd15b29449e89747	2024-12-11T22:40:40Z	CentricStorm		docs: update server streaming mode documentation (#9519)
973f328b1e92a6406030442dfd15b29449e89747	235f6e14bf0ed0211c51aeff14139038ae1000aa fb18934a97425c42c8b32a1baaa94f0080eb051d	2024-12-11T23:14:46+02:00	Georgi Gerganov		Merge pull request #10788 from ggerganov/gg/gguf-py-0.11.0
235f6e14bf0ed0211c51aeff14139038ae1000aa	1a31d0dc00ba946d448e16ecc915ce5e8355994e	2024-12-11T20:52:14+01:00	Xuan Son Nguyen		server : (UI) add tok/s, get rid of completion.js (#10786)
4b4d92b0986e3b627b9a9ef4782973108bf47691	43041d2eb32623d5b6ca734313327abe96f73146	2024-12-11T10:47:43Z	CentricStorm		docs: fix server documentation formatting (#10776)
b685daf3867c54e42a9db484d7b92619021d4510	dafae66cc242eb766797194d3c85c5e502625623	2024-12-10T14:23:17-06:00	Jeff Bolz		vulkan: request round-to-even for fp16 in im2col/rope_head (#10767)
750cb3e246f7e544124cf18cb0c5e0c8b7e38738	a86ad841f103e471ac0fd7ee8852d1eb5015ce89	2024-12-10T18:23:24+01:00	Andreas Kieslinger		CUDA: rename macros to avoid conflicts with WinAPI (#10736)
a86ad841f103e471ac0fd7ee8852d1eb5015ce89	a05e2afcc241c1ecd38ec5cb4c579d90cdf3f918	2024-12-10T17:22:34Z	Yüg		server : add flag to disable the web-ui (#10762) (#10751)
ce8784bdb153ff7794dde5a50b0ebfa51baa6171	e52522b8694ae73abf12feb18d29168674aa1c1b	2024-12-08T23:04:29+01:00	Xuan Son Nguyen		server : fix format_infill (#10724)
e52522b8694ae73abf12feb18d29168674aa1c1b	06d70147e6480c021e493c442ae0f0d83ae366de	2024-12-08T20:38:51+01:00	Xuan Son Nguyen		server : bring back info of final chunk in stream mode (#10722)
3573fa8e7b7f0865638b52b4e9b4d2006f0558a2	d9c3ba2b7749c00df477599aa141a98b4521aa2c	2024-12-07T20:21:09+01:00	Xuan Son Nguyen		server : (refactor) no more json in server_task input (#10691)
ce4a7b849388b67d45ad420bdd82d5efcd55647a	19d8762ab61df8286367588a80b9c7db4cb568db	2024-12-07T18:02:05+02:00	Georgi Gerganov		server : various fixes (#10704)
19d8762ab61df8286367588a80b9c7db4cb568db	c2a16c0bdbe2e51adf318918bad82f0c3e3d6f3b	2024-12-07T13:37:50+01:00	Djip007		ggml : refactor online repacking (#10446)
c2a16c0bdbe2e51adf318918bad82f0c3e3d6f3b	3df784b3050f657ea681f804187ce5bddb433e88	2024-12-07T11:52:44+02:00	Georgi Gerganov		server : fix free of spec context and batch (#10651)
f162d45a21b27f7613f14539f9a4932d6ff3ca48	6c5bc0625fae6909cb40def15bc4bb45db6f7f4d	2024-12-06T13:29:05+01:00	Xuan Son Nguyen		common : bring back --no-warmup to server (#10686)
6c5bc0625fae6909cb40def15bc4bb45db6f7f4d	7736837d62efed1dbebfe579472fca041eda12d6	2024-12-06T11:14:32+01:00	Xuan Son Nguyen		server : (refactoring) do not rely on JSON internally (#10643)
7736837d62efed1dbebfe579472fca041eda12d6	c9c6e01daedac542b174c235872569fce5385982	2024-12-05T23:36:41+02:00	Plamen Minev		fix(server) : not show alert when DONE is received (#10674)
1da7b765692764a8b33b08da61cbee63812a7bd9	59f4db10883a4f3e855cffbf2c3ab68430e95272	2024-12-04T22:38:20+02:00	Georgi Gerganov		server : fix speculative decoding with context shift (#10641)
91c36c269bca75b2d08119c653512cd20b4ea2ba	1cd3df46bd49a0c1c78da8b68c956448a73b7476	2024-12-03T19:38:44+01:00	Xuan Son Nguyen		server : (web ui) Various improvements, now use vite as bundler (#10599)
efb6ae963031709fc331e6e48cc4606ac8f9c3a7	667d70d1704dfa6977505f5d01d4638669b90dce	2024-12-02T19:27:24+01:00	PAB		feat: add `GGML_UNARY_OP_ARGMAX` Metal kernel (ggml/1019)
3b4f2e33e2cbfca621e623c4b92b88da57a8c2f4	82bca2257b3cec72676abb26011f1b99fcdab29d	2024-12-03T12:54:30+01:00	Xuan Son Nguyen		llama : add missing LLAMA_API for llama_chat_builtin_templates (#10636)
70b98fadbc8c07a0144f3b50a4d7ab7e2aeff878	642330ac7cea11dc1f9d3df2b8f3dbd10b5e3f3e	2024-12-03T11:20:00+02:00	Georgi Gerganov		server : fix default draft model parameters (#10586)
642330ac7cea11dc1f9d3df2b8f3dbd10b5e3f3e	8648c521010620c2daccfa1d26015c668ba2c717	2024-12-02T22:10:19+01:00	Xuan Son Nguyen		llama : add enum for built-in chat templates (#10623)
64ed2091b24b2f9747148fdf49a34ed5938762c3	991f8aabeec89d801300bb179e52013fb0eb0584	2024-12-02T21:45:54+08:00	haopeng		server: Add "tokens per second" information in the backend (#10548)
86dc11c5bcf34db2749d8bd8d4fa07a542c94f84	6acce3971098772a8aacb10fe8550b4119110581	2024-12-01T12:33:12+01:00	alek3y		server : bind to any port when specified (#10590)
b782e5c7d453b3f1fa8dc6c34cde7e2fa946af93	3a8e9af402f7893423bdab444aa16c5d9a2d429a	2024-11-29T21:48:56+01:00	Xuan Son Nguyen		server : add more test cases (#10569)
f095a649ec390e04dfab1b04e646ae8549dafaef	678d7994f4da0af3d29046be99950ac999ee9762	2024-11-29T00:18:02-06:00	Jeff Bolz		vulkan: get the first command buffer submitted sooner (#10499)
6c595676899013102fdb0aa4b06a49954300c94a	890719311b6535e572f15965c6d7ec4ac2537f60	2024-11-28T19:17:49+01:00	Xuan Son Nguyen		server : (tests) don't use thread for capturing stdout/stderr, bump openai client library (#10568)
45abe0f74ee281aea6e5283c1e738061256cfcae	0bbd2262a3263f37385297b30de37941836e57f7	2024-11-26T16:20:18+01:00	Xuan Son Nguyen		server : replace behave with pytest (#10416)
7db3846a94ce7683b3e8120abe427457edf840c9	c6807b3f28cc3dbfda3ec390bcb87e69fb5634e2	2024-11-26T13:05:20+01:00	Diego Devesa		ci : publish the docker images created during scheduled runs (#10515)
84e1c33cde9e0a7aafcda2d4f21ba51c300482d7	811872a59daefb25fc0c4326bcb6d8ae893c2f7c	2024-11-26T13:36:40+02:00	Georgi Gerganov		server : fix parallel speculative decoding (#10513)
9fd8c2687f5aa2f095ac6e12a376e1c0583888e8	47f931c8f9a26c072d71224bc8013cc66ea9e445	2024-11-25T22:28:27+02:00	Georgi Gerganov		server : add more information about error (#10455)
47f931c8f9a26c072d71224bc8013cc66ea9e445	106964e3d266740f571b5aad7b57545b4a901ac9	2024-11-25T21:50:07+02:00	Georgi Gerganov		server : enable cache_prompt by default (#10501)
a9a678a6b2264e5895533217b0cf8f250534cc58	9ca2e677626fce759d5d95c407c03677b9c87a26	2024-11-25T08:11:55-08:00	brucepro		Add download chat feature to server chat (#10481)
9ca2e677626fce759d5d95c407c03677b9c87a26	5931c1f233c616083d64e41a228249d58e039aa5	2024-11-25T16:31:38+02:00	Georgi Gerganov		server : add speculative decoding support (#10455)
5a8987793f3e7c1fbfa6806bfcd17d578071b6c9	d9d54e498d38ec99bbc0031022f9c92711e97bbc	2024-11-25T17:31:10+08:00	Neo Zhang Jianyu		[SYCL] Fix building Win package for oneAPI 2025.0 update (#10483)
6dfcfef0787e9902df29f510b63621f60a09a50b	599b3e0cd40432cd1975a8906f3db70bbe53b627	2024-11-22T17:44:08+08:00	蕭澧邦		ci: Update oneAPI runtime dll packaging (#10428)
bcdb7a23862b61aa307fc462fadfe1e2e653d010	f245cc28d4eb900efad0bc740145f58d713c6e4f	2024-11-16T18:26:54+05:00	MaggotHATE		server: (web UI) Add samplers sequence customization (#10255)
9901068ac78838745e604fffb4601d315a610456	231f9360d94446cd083b6b116f63991b1328c484	2024-11-15T05:48:49-04:00	Xuan Son Nguyen		server : (web UI) add copy button for code block, fix api key (#10242)
5a54af4d4f588f109f31e456483fdf77096399d9	1607a5e5b08f4e55f118af3d7de325949d8f1835	2024-11-15T04:09:12+01:00	Romain Biessy		sycl: Use syclcompat::dp4a (#10267)
fb4a0ec0833c71cff5a1a367ba375447ce6106eb	5ea926dad7f62ebccff7b24784bd1e01a06d13ae	2024-11-13T20:00:35+02:00	Michael Podvitskiy		llama : propagate the results of `graph_compute` (#9525)
ff7fb670d0a62897c5662536aeb53422c549fbe8	0e712a5acbbdd1593e5aeb86d4f6b896a11b438c	2024-11-13T11:16:30Z	Alexey Parfenov		server : add missing docs (#10269)
0e712a5acbbdd1593e5aeb86d4f6b896a11b438c	a0ec17b32ec6077f5ca22fe833ebdc9b86795a4d	2024-11-13T19:15:23+08:00	Jhen-Jie Hong		server : fix incorrect res in validate_model_chat_template (#10272)
b141e5f6efbab3a00633df88c4f9425bfe8b78ab	4b3a9212b602be3d4e2e3ca26efd796cef13c55e	2024-11-11T08:38:43+02:00	Georgi Gerganov		server : enable KV cache defrag by default (#10233)
505f33274d60676320216b662a97672a76ec600e	160687b3ed002eee83a04de83a9cd752f928ced1	2024-11-11T00:42:25+05:00	MaggotHATE		server : (web UI) Add back sampler settings (#10239)
76c6e7f10551960e4ec9e14e0535b72081f1c7ad	a71d81cf8c1afb26b166f897c94ee1581f9fac7d	2024-11-07T18:44:38-04:00	Xuan Son Nguyen		server : minor UI fix (#10207)
a71d81cf8c1afb26b166f897c94ee1581f9fac7d	eec4d71737b32f312e0082b671629a0368e1a20d	2024-11-07T17:31:10-04:00	Xuan Son Nguyen		server : revamp chat UI with vuejs and daisyui (#10175)
b11f9ba9b8ce319f04b88afe40d264e6b7f4ba46	94d8cb8be13b7c4d04eeca5a2b956b9148e6f222	2024-11-06T13:29:01+02:00	Georgi Gerganov		server : remove hack for extra parallel slot (#10187)
9e0ecfb697d297355e43c20559d29bcc71beb0c3	6a066b9978533e2ab9890b7f4f8c0262d91798b3	2024-11-04T16:33:29+01:00	Xuan Son Nguyen		server : clarify /slots endpoint, add is_processing (#10162)
42cadc74bda60afafb45b71b1a39d150ede0ed4d	45950415ed985830c59bf42cf9c9216b20cf08ef	2024-11-02T16:34:56Z	sasha0552		server : fix slot selection by lru (#10126)
45950415ed985830c59bf42cf9c9216b20cf08ef	1926d6e39d6f6358bc1a4c52316a560178be7233	2024-11-02T18:34:00+02:00	Georgi Gerganov		server : fix endpoint checks (#10135)
d865d1478cd4e403f82d793c2afcd0f943412f05	1804adb0cfee4811eaf633741503d683a46e4c77	2024-11-01T13:33:14Z	sasha0552		server : fix smart selection of available slot (#10120)
e597e50794f07ec8dc24b9efb18f94ec6386fda0	85679d37f34f66783cc04664a06c405b28e8e035	2024-11-01T11:09:59+08:00	Zhenwei Jin		build: fix build error in Windows env with OneAPI setup (#10107)
0a683e8088d849626e7471f9e2ed381f7dbdf2e9	dea5e86051aadcdf42f7db7a8855a78d8f5ff3d6	2024-10-31T06:02:35-07:00	Kevin Gibbons		server : include scheme when printing URL (#10106)
8125e6cbfcf2b3b9066e4d923aca9295526730f5	8841ce3f439de6e770f70319b7e08b6613197ea7	2024-10-28T08:49:32+02:00	Georgi Gerganov		server : don't overfill the batch during infill (#10018)
bc5ba007b2c83ac95875e68724dabfc12159fc61	958367bf530d943a902afa1ce1c342476098576b	2024-10-25T10:13:46+03:00	Georgi Gerganov		server : check that the prompt fits in the slot's context (#10030)
958367bf530d943a902afa1ce1c342476098576b	40f2555797f97314de749873cdc29dc102be66e2	2024-10-24T21:51:22+02:00	Xuan Son Nguyen		server : refactor slot input data, move tokenizer to HTTP thread (#10023)
0a1c750c80147687df267114c81956757cc14382	190a37d7977eb5bd6a729299bd1e371208c87149	2024-10-23T13:27:51-06:00	wwoodsTM		server : samplers accept the prompt correctly (#10019)
6b8447352df3d662b56280c8fc38d7f092885787	674804a99617b4f90292b4080ecab450ea3d30ba	2024-10-22T16:16:01+08:00	leo-pony		[CANN] Adapt to dynamically loadable backends mechanism (#9970)
afd9909a6481402844aecefa8a8908afdd7f52f1	87421a23e8c60e00a7b227d501e8aab2a1aff7ce	2024-10-18T14:33:58+03:00	Radoslav Gerganov		rpc : backend refactoring (#9912)
87421a23e8c60e00a7b227d501e8aab2a1aff7ce	60ce97c9d809f4b040e90b597468b839df5728d0	2024-10-18T06:46:16+01:00	Ouadie EL FAROUKI		[SYCL] Add SYCL Backend registry, device and Event Interfaces (#9705)
60ce97c9d809f4b040e90b597468b839df5728d0	8901755ba328643c9ab071c20e1939ea52951a0e	2024-10-18T13:34:36+08:00	Ma Mingfei		add amx kernel for gemm (#8998)
8901755ba328643c9ab071c20e1939ea52951a0e	6f55bccbb8835d42147add4ee48807450f5ff535	2024-10-18T07:32:19+03:00	Georgi Gerganov		server : add n_indent parameter for line indentation requirement (#9929)
1f66b699c48cb5ab3265ed72c48e8549b1674291	0e41b300ed28f7fe185d938b2e3d56a0bf7411ed	2024-10-16T08:35:53Z	Alexey Parfenov		server : fix the disappearance of the end of the text (#9867)
223c25a72fcc3f65cdfd7f5d57edd5b44b550e18	fbc98b748e7b075e327bcf13237057f647678049	2024-10-15T16:28:55+03:00	Georgi Gerganov		server : improve infill context reuse (#9894)
fbc98b748e7b075e327bcf13237057f647678049	dcdd535302fc9702a4709be25f56540d65163a44	2024-10-15T15:54:55+05:00	MaggotHATE		sampling : add XTC sampler (#9742)
dcdd535302fc9702a4709be25f56540d65163a44	4c42f93b22146c83b763d8cbee5fafc512746649	2024-10-15T12:48:44+03:00	Georgi Gerganov		server : update preact (#9895)
a89f75e1b7b90cb2d4d4c52ca53ef9e9b466aa45	13dca2a54a394757d56fdd652b9f0df08f44ea22	2024-10-14T15:04:36+08:00	VoidIsVoid		server : handle "logprobs" field with false value (#9871)
d4c19c0f5cdb1e512573e8c86c79e8d0238c73c4	c7181bd294757dd80a7904e3dd0fea2d0be914e7	2024-10-13T21:31:35+03:00	Georgi Gerganov		server : accept extra_context for the infill endpoint (#9874)
c7181bd294757dd80a7904e3dd0fea2d0be914e7	92be9f12164f18ce845a5bab60cefa5f7fec6836	2024-10-13T18:52:48+03:00	Georgi Gerganov		server : reuse cached context chunks (#9866)
edc265661cd707327297b6ec4d83423c43cb50a5	1bde94dd024b632f98428f4bf2ce483295130779	2024-10-12T16:14:27+03:00	Georgi Gerganov		server : add option to time limit the generation phase (#9865)
1bde94dd024b632f98428f4bf2ce483295130779	95c76e8e92ecc93f784b185eafae36a0e7ad2fa3	2024-10-12T16:06:31+03:00	Georgi Gerganov		server : remove self-extend features (#9860)
95c76e8e92ecc93f784b185eafae36a0e7ad2fa3	11ac9800aff532715a5bc7991062c68ba3472e6e	2024-10-12T14:51:54+03:00	Georgi Gerganov		server : remove legacy system_prompt feature (#9857)
11ac9800aff532715a5bc7991062c68ba3472e6e	943d20b4111c746bcd9dbc7e4771de313b08b50c	2024-10-12T08:21:51+03:00	Georgi Gerganov		llama : improve infill support and special token detection (#9798)
0e9f760eb12546704ef8fa72577bc1a3ffe1bc04	cf8e0a3bb9c0e93e371773b282054cdbbb231038	2024-10-10T20:14:55+02:00	Diego Devesa		rpc : add backend registry / device interfaces (#9812)
458367a90606448a9c0262b276947c9e536086e0	fa42aa6d8902cc4eaf31866b3b3b7b61b69da930	2024-10-08T13:27:04+02:00	Xuan Son Nguyen		server : better security control for public deployments (#9776)
7254cdf7e8d6312840509ca8d766358c687c6266	cad341d88924788b940997c55e7bef000c99e784	2024-09-29T23:18:02+02:00	Johannes Gäßler		ggml: fix gradient allocation logic (ggml/966)
f4d2b8846a6b34419ff9e9491aee6cd95e444bfc	1b2f992cd2cff0b69e5abe78bb8888d51ed19d67	2024-09-28T17:42:03+03:00	Georgi Gerganov		llama : add reranking support (#9510)
1b2f992cd2cff0b69e5abe78bb8888d51ed19d67	739842703e32cd43443c45e0b4f6647cc4e6b3d6	2024-09-28T14:32:46+02:00	slaren		test-backend-ops : use flops for some performance tests (#9657)
95bc82fbc0df6d48cf66c857a4dda3d044f45ca2	7691654c68aa5316108f881136c59f815ccb6809	2024-09-26T17:38:31+08:00	Neo Zhang Jianyu		[SYCL] add missed dll file in package (#9577)
afbbfaa537a96f562c34df4542930fa951b40d9e	3d6bf6919f7b10726421779cd344f2da05421c68	2024-09-25T14:05:13+02:00	Xuan Son Nguyen		server : add more env vars, improve gen-docs (#9635)
3d6bf6919f7b10726421779cd344f2da05421c68	904837e0cb2f5f01bf5d5901b7aa57a026860ae4	2024-09-25T01:06:52-06:00	Gabe Goodhart		llama : add IBM Granite MoE architecture (#9438)
0aa15011e315659640504731d1d05663837130fa	b0f27361f3539a81d983a8b045f3c61e682d9fc0	2024-09-23T23:04:39-07:00	StrangeBytesDev		server : add newline after chat example (#9616)
0b3bf966f47bf2ba88e5d4e3ed429602008c7e63	f0c7b5edf82aa200656fd88c11ae3a805d7130bf	2024-09-23T22:23:54+02:00	Xuan Son Nguyen		server : add --no-context-shift option (#9607)
f0c7b5edf82aa200656fd88c11ae3a805d7130bf	1d48e98e4f3316bd2f6b187d288c7b6cb88d5cb3	2024-09-23T11:42:43-07:00	Max Krasnyansky		threads: improve ggml_barrier scaling with large number of threads (#9598)
6026da52d6942b253df835070619775d849d0258	eca0fab44eb449ed34e17a9b651ae7398b494117	2024-09-19T12:44:53+03:00	Georgi Gerganov		server : clean-up completed tasks from waiting list (#9531)
8a308354f6520df6bea851b435bd8054ee5617b4	f799155ab8279cfa668086ce584aa52ecc05f5e5	2024-09-18T01:50:34-05:00	Vinesh Janarthanan		server : match OAI structured output response (#9527)
f799155ab8279cfa668086ce584aa52ecc05f5e5	faf67b3de4688f47c3b1019c89df255df2fd59b4	2024-09-18T14:28:20+08:00	Eric Zhang		server : fix OpenSSL build (remove obsolete `LOG_INFO`) (#9529)
8b836ae731bbb2c5640bc47df5b0a78ffcb129cb	8344ef58f8cdb8ebd6faf4463ca32ae91c374c81	2024-09-17T09:35:38-04:00	Bert Wagner		arg : add env variable for parallel (#9513)
0226613853133c081b55bb892a41bb5eacc0bc94	503147a9f9d195d6a14e7c998df23b6eb61f2bae	2024-09-17T01:19:46-07:00	Max Krasnyansky		threadpool : skip polling for unused threads (#9461)
441b72b91f818fe69497e5816f87969e90c73c43	c4965a64f72ac9434c21cf0e1c3421d13e889155	2024-09-16T01:20:01-05:00	Vinesh Janarthanan		main : option to disable context shift (#9484)
dcdcee3a744f39714503ee2b19c49b7c7b6209c9	1f4111e540bacec8d00ca9fd96417bf4c1339394	2024-09-14T17:36:44+08:00	VoidIsVoid		server: add data: [DONE] to /chat/completions stream response (#9459)
feff4aa8461da7c432d144c11da4802e41fef3cf	0abc6a2c25272d5cf01384dda8ee8bfec4ba8745	2024-09-13T14:23:11+02:00	Xuan Son Nguyen		server : add loading html page while model is loading (#9468)
0abc6a2c25272d5cf01384dda8ee8bfec4ba8745	bd35cb0ae357185c173345f10dc89a4ff925fc25	2024-09-13T09:53:38+03:00	Georgi Gerganov		llama : llama_perf + option to disable timings during decode (#9355)
78203641fee3b1f82abaff0c7f667e1b4a286390	e6b7801bd189d102d901d3e72035611a25456ef1	2024-09-12T22:30:11+02:00	Mathijs Henquet		server : Add option to return token pieces in /tokenize endpoint (#9108)
8d300bd35fbe23b35a4e1ece0cf0fe8f43331029	49006c67b4c6cc2e7c75a875b4d6e161ebae287c	2024-09-10T22:40:59+02:00	matteo		enable --special arg for llama-server (#9419)
bfe76d4a17228bfd1565761f203123bc4914771b	293bebe0773c907c0c866213856eeba41b035df1	2024-09-09T23:36:09+02:00	Xuan Son Nguyen		common : move arg parser code to `arg.cpp` (#9388)
1b9ae5189cd279c6b45e36d43e4f9ccae628d02f	e32d0816edfd247784f6780b0bb9ae0bceef5e47	2024-09-07T20:43:51+02:00	Xuan Son Nguyen		common : refactor arg parser (#9308)
df270ef74596da8f1178f08991f4c51f18c9ee82	947538acb8617756a092042ff7e58db18dde05ec	2024-09-07T15:16:19+03:00	Georgi Gerganov		llama : refactor sampling v2 (#9294)
9b2c24c0993487d3b34a873980e292da571481f3	134bc38ecf3e2c5460581badce289a1ffa680453	2024-09-06T23:21:29+02:00	Xuan Son Nguyen		server : simplify state machine for slot (#9283)
4a1411b4f17b6569dc0a067e5914dcc0f738b370	8ebe8ddebd68526757c631cd019de009697c63c2	2024-09-06T14:06:04+02:00	Xuan Son Nguyen		server : fix missing lock (#9334)
9bc6db28d011d47a5f318dc4aebbe7927fac4629	32b2ec88bc44b086f3807c739daf28a1613abde1	2024-09-05T21:48:47-04:00	compilade		ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)
32b2ec88bc44b086f3807c739daf28a1613abde1	1031771faaba28d07b4ec6a812cb21532efc8c31	2024-09-06T06:34:36+08:00	awatuna		Update build.yml (#9184)
82e3b03c11826d20a24ab66d60f4de58f48ddcdb	9379d3cc1718e9ec6ab5ffcb60a06bbe048a61ee	2024-09-04T11:08:32+03:00	Radoslav Gerganov		rpc : make RPC servers come first in the device list (#9296)
b69a480af4db8ffd6cbb2efe7ed8132bc7d39073	48baa61eccdca9205daf8d620ba28055c2347b64	2024-09-03T10:00:36+03:00	Georgi Gerganov		readme : refactor API section + remove old hot topics
48baa61eccdca9205daf8d620ba28055c2347b64	f1485161e58d562099dd050f8ac3a9ea9f4cd765	2024-09-02T22:08:38+02:00	Xuan Son Nguyen		server : test script : add timeout for all requests (#9282)
6e7d133a5f9409dd257fad90d7f320721b07a1b2	b60074f1c26d8354053a952844ef3f7ebefd8803	2024-09-02T17:11:51+02:00	Xuan Son Nguyen		server : refactor multitask handling (#9274)
8f1d81a0b6f50b9bad72db0b6fcd299ad9ecd48c	a47667cff41f5a198eb791974e0afcc1cddd3229	2024-09-01T22:38:17+08:00	Molly Sophia		llama : support RWKV v6 models (#8980)
42c76d1358021ccdbe8ba89109c143dd7ae166df	9f7d4bcf5c27d37b0c7da82eeaf9c1499510554b	2024-08-29T19:20:53-04:00	Faisal Zaghloul		Threadpool: take 2 (#8672)
9f7d4bcf5c27d37b0c7da82eeaf9c1499510554b	1d1ccce67613674c75c9c7e3fa4c1e24e428ba48	2024-08-27T18:28:06+08:00	Jan Boon		server : fix crash when error handler dumps invalid utf-8 json (#9195)
a77feb5d71831c61e455541e8a655b9f0337ea8c	2e59d61c1b321431c597c1f12249273427d5640d	2024-08-27T11:07:01+02:00	Xuan Son Nguyen		server : add some missing env variables (#9116)
e5edb210cd361689da41f032f1b36c45ff1bf9be	0c41e03ceba1aafaf469476a56347419d5785376	2024-08-26T12:16:57+03:00	Georgi Gerganov		server : update deps (#9183)
a1631e53f6763e17da522ba219b030d8932900bd	fc54ef0d1c138133a01933296d50a36a1ab64735	2024-08-21T17:58:11-04:00	compilade		llama : simplify Mamba with advanced batch splits (#8526)
fc54ef0d1c138133a01933296d50a36a1ab64735	b40eb84895bf723c7b327a1e3bf6e0e2c41877f8	2024-08-21T11:04:34+02:00	Xuan Son Nguyen		server : support reading arguments from environment variables (#9105)
18eaf29f4c5f7c8e89412f3a9a0392a9e4e01d75	554b049068de24201d19dde2fa83e35389d4585d	2024-08-19T10:10:21+03:00	Radoslav Gerganov		rpc : prevent crashes on invalid input (#9040)
8b3befc0e2ed8fb18b903735831496b8b0c80949	d565bb2fd5a2a58b9924a7a34e77a87c78c52137	2024-08-16T17:19:05+02:00	Xuan Son Nguyen		server : refactor middleware and /health endpoint (#9056)
d565bb2fd5a2a58b9924a7a34e77a87c78c52137	ee2984bdaf10c14d440ad873a049bcc09b786d9b	2024-08-16T21:34:41+08:00	tc-mb		llava : support MiniCPM-V-2.6 (#8967)
37501d9c79ed5897db4b73ea7502211d25b3f763	4af8420afba39de4968adf2695ce12fd42422a13	2024-08-15T15:28:05+08:00	Riceball LEE		server : fix duplicated n_predict key in the generation_settings (#8994)
234b30676a97ce227b604c38beb9dcaca406dea9	5fd89a70ead34d1a17015ddecad05aaa2490ca46	2024-08-15T08:21:57+02:00	Jiří Podivín		server : init stop and error fields of the result struct (#9026)
98a532d474c73d3494a5353024cb6a4fbbabbb35	43bdd3ce188cd247bda7c1bd1ad01fa64e566690	2024-08-14T02:51:02-04:00	compilade		server : fix segfault on long system prompt (#8987)
5ef07e25ac39e62297a67208c5bcced50835a2dd	4134999e01f31256b15342b41c4de9e2477c4a6c	2024-08-12T10:21:50+03:00	Georgi Gerganov		server : handle models with missing EOS token (#8997)
7c3f55c10051c634546247387c5c359c9d499360	911b437f228e75aa3d235acec21bfddd23ecce2f	2024-08-10T11:43:26+02:00	fairydreaming		Add support for encoder-only T5 models (#8900)
3071c0a5f218f107dabd13b73f6090af683ef5ec	4305b57c80eff4f0df5f6acb60b292f03b8f0dd0	2024-08-09T18:33:53+08:00	tc-mb		llava : support MiniCPM-V-2.5 (#7599)
daef3ab233fc02e4c53afd9b07366379876f00d1	345a686d8271a24db20d31789c0d4b9ed51dcb0c	2024-08-09T08:32:02+02:00	Mathieu Geli		server : add one level list nesting for embeddings (#8936)
1e6f6554aa11fa10160a5fda689e736c3c34169f	641f5dd2a6422941faa9f32ab5cb50fc1b24c1f5	2024-08-06T17:33:39+02:00	Xuan Son Nguyen		server : add lora hotswap endpoint (WIP) (#8857)
a3738b2fa7c60ef2c4592435d1aa7fb8f1f69c3e	655858ace0cf2720e56eb01f84ad05e0c94ada3c	2024-08-04T17:28:08+02:00	0cc4m		vulkan : implement Stable Diffusion operators (ggml/904)
978ba3d83d17b10fdf9807006048432b5b3769fc	ecf6b7f23e664afd7ff856ec39034240ce438daa	2024-08-04T18:16:23Z	ardfork		Server: Don't ignore llama.cpp params (#8754)
ecf6b7f23e664afd7ff856ec39034240ce438daa	01aae2b4975b57a265ce8194928fd87f2d71027e	2024-08-04T03:55:03-07:00	Brian Cunnie		batched-bench : handle empty `-npl` (#8839)
afbbcf3c04e3c6420cad3d72571478cd62ac176c	ed9d2854c9de4ae1f448334294e61167b04bec2a	2024-07-31T18:59:09-05:00	Igor Okulist		server : update llama-server embedding flag documentation (#8779)
01aec4a6310ab0160483196db0e726d78d4c94b6	41cd47caab88c442edc50e90c8d8d0ac3e82768d	2024-07-25T18:10:16-04:00	Yaiko		server : add Speech Recognition & Synthesis to UI (#8679)
4b0eff3df58d8d86e47348fb73d54da3194d416d	8a4bad50a8ed24ed1e9df003521468dcc37320e8	2024-07-25T13:43:27+05:30	Ujjawal Panchal		docs : Quantum -> Quantized (#8666)
b841d0740855c5af1344a81f261139a45a2b39ee	64cf50a0ed62d41e4f6c13e08a9b6b0816f46c6e	2024-07-23T17:37:42+03:00	Vali Malinoiu		server : fix URL.parse in the UI (#8646)
938943cdbf4dd79005a394d732bc226f9e34e0ff	751fcfc6c33ea5f43cadd4d976f8fb176871df5e	2024-07-23T13:10:17+03:00	Georgi Gerganov		llama : move vocab, grammar and sampling into separate files (#8508)
566daa5a5b38018b2727950bbd280239adb981b6	6f11a83e4e7700fdf353ed4a29599cb662c792f6	2024-07-22T15:44:53+02:00	Jiří Podivín		*.py: Stylistic adjustments for python (#8233)
628154492a0b2dcc954a3af99e5c267097568eae	04bab6b7da0ed2b0a57174a57784d602aabb6c10	2024-07-22T16:02:09+08:00	Jan Boon		server : update doc to clarify n_keep when there is bos token (#8619)
69c487f4ed57bb4d4514a1b7ff12608d5a8e7ef0	07283b1a90e1320aae4762c7e03c879043910252	2024-07-20T22:25:26+02:00	Johannes Gäßler		CUDA: MMQ code deduplication + iquant support (#8495)
be0cfb41752551a4680ee7dfd29f2a05b50db442	b57eb9ca4fb79f3163c6a69e154ff76157a4f716	2024-07-19T14:34:55+03:00	Georgi Gerganov		readme : fix server badge
0d2c7321e9678e91b760ebe57f0d063856bb018b	672a6f101839a150180fc28891ebed379c8f2353	2024-07-18T18:43:49+08:00	Eric Zhang		server: use relative routes for static files in new UI (#8552)
3807c3de04cde853418033c95e96642876545f3e	e02b597be3702174e7b47b44cd03e1da1553284b	2024-07-18T16:06:22+08:00	RunningLeon		server : respect `--special` cli arg (#8553)
f17f39ff9cb71fa7b0eda0c649bb0ce9b2d8a6b8	9104bc20edf47f74dc49379b7d61d0c6e85a4882	2024-07-15T08:04:56-04:00	M-A		server: update README.md with llama-server --help output [no ci] (#8472)
4e24cffd8cccd653634e24ee461c252bd77b1426	6af51c0d96e6268769fc05c98d5b1a5e832c0017	2024-07-12T14:48:15+03:00	Georgi Gerganov		server : handle content array in chat API (#8449)
c3ebcfa148e867a68e78fd5c4f0c23e8f84c788b	8a4441ea1a2564578134404f31158c318e9c0bf3	2024-07-12T03:14:12-05:00	Douglas Hanley		server : ensure batches are either all embed or all completion (#8420)
278d0e18469aacf505be18ce790a63c7cc31be26	dd07a123b79f9bd9e8a4ba0447427b3083e9347a	2024-07-10T20:08:17-04:00	Clint Herron		Initialize default slot sampling parameters from the global context. (#8418)
dd07a123b79f9bd9e8a4ba0447427b3083e9347a	f4444d992c16b6b9442f4770c7c3a10b19a08343	2024-07-10T12:35:18-04:00	Clint Herron		Name Migration: Build the deprecation-warning 'main' binary every time (#8404)
0f1a39f3439825acf7e3a1663566d410be152170	83321c6958acf20747d288031174cc1bf8816e33	2024-07-10T07:14:51-05:00	Dibakar Gope		ggml : add AArch64 optimized GEMV and GEMM Q4 kernels (#5780)
a59f8fdc85e1119d470d8766e29617962549d993	fd560fe680c72fd0a0af2bc8881add20ad919071	2024-07-09T18:26:40-04:00	Clint Herron		Server: Enable setting default sampling parameters via command-line (#8402)
3fd62a6b1c9ca7b7c0093e984cc9c133c6f2726d	a8db2a9ce64cd4417f6a312ab61858f17f0f8584	2024-07-07T15:04:39-04:00	compilade		py : type-check all Python scripts with Pyright (#8341)
cb4d86c4d723af87d3d7e3177e9485f200391384	86e7299ef5dff0f388922dc6fcbce009e99d8005	2024-07-07T11:10:38+02:00	Bjarke Viksøe		server: Retrieve prompt template in /props (#8337)
807b0c49ff7071094f97ebc3a0a8e2b9e274f503	f8c4c0738d72d2162736edd72dd5db8b269adca1	2024-07-04T15:46:11+02:00	fairydreaming		Inference support for T5 and FLAN-T5 model families (#5763)
a95631ee97bb24861af6bdeec380270459631e8e	f3f65429c44bb195a9195bfdc19a30a79709db7b	2024-06-26T19:26:13+03:00	Georgi Gerganov		readme : update API notes
f3f65429c44bb195a9195bfdc19a30a79709db7b	88540445615e77a0177fcca43aaa8e9d8eea6864	2024-06-26T18:33:02+03:00	Georgi Gerganov		llama : reorganize source code + improve CMake (#8006)
6777c544bdd8c5d9de3220d6e2557957bbbf2a4f	163d50adaf8897d8b734d701ff332de6be63d484	2024-06-26T01:45:58+01:00	Olivier Chafik		`json`: fix additionalProperties, allow space after enum/const (#7840)
dd047b476c8b904e0c25e5dbc5bee6ffde2f6e17	925c30956dd17723c3a25297bcd0a609aec60663	2024-06-25T19:20:06+02:00	slaren		disable docker CI on pull requests (#8110)
925c30956dd17723c3a25297bcd0a609aec60663	c8ad35955ad2c68db172dcd0e857423ab128518d	2024-06-25T08:13:27-07:00	joecryptotoo		Add healthchecks to llama-server containers (#8081)
48e6b92cc378c937e59719f2c0f482bf76c9ca81	3791ad219323389106dc3fd80814eb5bbb7b80de	2024-06-25T13:56:49+02:00	Xuan Son Nguyen		Add chat template support for llama-cli (#8068)
3791ad219323389106dc3fd80814eb5bbb7b80de	f702a90e245499283d6de0b287701c723cda2a87	2024-06-25T16:57:35+05:30	HanishKVC		SimpleChat v3.1: Boolean chat request options in Settings UI, cache_prompt (#7950)
6a2f298bd784403c5c33eebb822217ec5d9b5590	11318d9aa1f668aa10407a5cb9614371af32f3ce	2024-06-23T18:03:08+03:00	Aarni Koskela		server : fix JSON-Scheme typo (#7975)
b6b9a8e606da7764bd3649c2ea574979c85abd43	45c0e2e4c1268c2d7c8c45536f15e3c9a731ecdc	2024-06-23T13:14:45+02:00	slaren		fix CI failures (#8066)
ba5899315283eb1df3902363daf79bdc5eefe426	a7854743c5e6216a6178824a603aa9479728ddd5	2024-06-19T23:57:10Z	sasha0552		server : fix smart slot selection (#8020)
e6ecc2be470e3c5c6c5c9d8b90aa83a1f7725084	a94e6ff8774b7c9f950d9545baf0ce35e8d1ed2f	2024-06-18T09:37:20+03:00	Georgi Gerganov		whisper : use ggml_backend_sched (whisper/2239)
1c641e6aac5c18b964e7b32d9dbbb4bf5301d0d7	963552903f51043ee947a8deeaaa7ec00bc3f1a4	2024-06-13T00:41:52+01:00	Olivier Chafik		`build`: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
704a35b183748954013bd875bbbfdd9eaca14e62	dcf752707d96eb305f546526c7bc5d01f0831130	2024-06-12T14:42:29+03:00	Georgi Gerganov		server : restore numeric prompts (#7883)
dcf752707d96eb305f546526c7bc5d01f0831130	f2b5764beb35583295e2475479c18f249b139b58	2024-06-12T17:05:35+08:00	Meng, Hengyu		update intel docker oneapi-basekit to 2024.1.1-devel-ubuntu22.04 (#7894)
14f83526cd27f638c856ea6eff08110b9860eb2a	6fe42d073f0554eada93ac9d40574025aeedb703	2024-06-11T12:18:58-04:00	Deven Mistry		fix broken link in pr template (#7880) [no ci]
fd5ea0f897ecb3659d6c269ef6f3d833e865ead7	c28a83902cf6ab6a9e085ad6d4cc2e95c4ccfe40	2024-06-10T14:18:41+02:00	slaren		ci : try win-2019 on server windows test (#7854)
d9da0e4986f121c727bdd9579a6688097b11602c	1f0dabda8d5c131f9d4632aa41de74317cdd61fb	2024-06-10T14:59:55+03:00	Georgi Gerganov		server : improve "prompt" handling (#7847)
57bf62ce7cb75cca589943e2050d29bff4026e76	3e2ee443159724e2d3a0741f6b167e599ec088aa	2024-06-09T11:24:29-04:00	Nicolás Pérez		docs: Added initial PR template with directions for doc only changes and squash merges [no ci] (#7700)
3e2ee443159724e2d3a0741f6b167e599ec088aa	42b53d192f4e3abf1b7c8e424628424504ea5dc5	2024-06-09T12:50:35+02:00	mgroeber9110		server: do not remove whitespace at the start of a completion chunk (#7830)
fe1e3917cfa0f9397a765cfd0aef880674d938d5	d4d915d351d1f1270d56184bdd46672893e8a5d8	2024-06-09T01:43:39+02:00	slaren		Revert "[SYCL] Update rpc-server.cpp to include SYCL backend (#7682)" (#7808)
7a16ce7db2a74a223f0f3b9cee66d4539c5bce8f	da799b41891e34aac86ce4e173f9c4c0afd4fab3	2024-06-08T07:50:31Z	sasha0552		server : smart slot selection using Longest Common Prefix (#7728)
7027b27d765db95d4ac6b569d976e387a8715881	a5cabd76491f07494c5b8267f921c73f5e2bbfb4	2024-06-07T11:15:49+02:00	Johannes Gäßler		server: update cache_prompt documentation [no ci] (#7745)
a5cabd76491f07494c5b8267f921c73f5e2bbfb4	d5c938cd7716b9a2ace49a43a469dfbffcff4d28	2024-06-07T15:09:45+08:00	woodx		server : do not get prompt in infill mode (#7286)
ee459f40f65810a810151b24eba5b8bd174ceffe	f83351f9a62a6262f1fc3d08f320033089cddfb5	2024-06-06T19:19:59+03:00	Georgi Gerganov		server : fix --threads-http arg (#7801)
55b2d0849d3ec9e45e4a4d9e480f5fa7977872a6	f5d7b268ec4bf8628aa6ccc9f6631d0230dde76f	2024-06-06T10:07:06+01:00	Olivier Chafik		grammars: x{min,max} repetition operator (#6640)
2d08b7fbb483c14bd2b173d4cd51ea3a4f862e8f	d67caea0d6e6c303d31b01d0a010973e6c908dff	2024-06-06T07:19:49+02:00	slaren		docker : build only main and server in their images (#7782)
1442677f92e45a475be7b4d056e3633d1d6f813b	554c247caffed64465f372661f2826640cb10430	2024-06-04T21:23:39+03:00	Georgi Gerganov		common : refactor cli arg parsing (#7675)
6d1616944d9efd342ed2a4fd318722adfc9febcd	bde7cd3cd949c1a85d3a199498ac98e78039d46f	2024-06-04T10:01:09+03:00	Georgi Gerganov		ggml : prevent builds with -ffinite-math-only (#7726)
bde7cd3cd949c1a85d3a199498ac98e78039d46f	a5735e4426b19a3ebd0c653ad8ac01420458ee95	2024-06-03T20:03:26+03:00	Radoslav Gerganov		llama : offload to RPC in addition to other backends (#7640)
a5735e4426b19a3ebd0c653ad8ac01420458ee95	0b832d53ba0ffcc759c8d62ede3772dd62321f8e	2024-06-04T00:14:15+09:00	Masaya, Kato		ggml : use OpenMP as a thread pool (#7606)
7c4e5b7eae26581869e782015d9deca947c34997	9422c5e34bbd302493b77a8f6d546154a1f4fe82	2024-06-02T13:39:08-04:00	Austin		chore : add ignore rule for generated server themes (#7689)
9422c5e34bbd302493b77a8f6d546154a1f4fe82	e141ce624af57bdffbaf57014a044eb1d9689230	2024-06-02T19:13:54+10:00	nickp27		[SYCL] Update rpc-server.cpp to include SYCL backend (#7682)
2e666832e6ac78194edf030bd1c295e21bdb022c	2ac95c9d5678d05e253691fb1f26471675bff5ad	2024-06-01T21:31:48+02:00	Yazan Agha-Schrader		server : new UI (#7633)
2ac95c9d5678d05e253691fb1f26471675bff5ad	750f60c03e4d3f53fa51910551ce87a3d508d2d7	2024-06-01T21:50:18+05:30	HanishKVC		SimpleChat: Simple histogram/repeatMatching driven garbageTrimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer), Save/Restore session, Auto Settings UI (#7548)
a323ec60af14a33d560df98f2cc41b4112cb4f80	0515ad93f48df63bbff204eddb0cac75e8585c65	2024-05-31T22:23:04+03:00	Georgi Gerganov		server : update js (#7670)
972b555ab935705f3437abd5909a5c46852811f6	3854c9d07f67de7f8cd6d86117bfaef47549b05a	2024-05-30T09:52:39+02:00	Johannes Gäßler		README: explain parallel build [no ci] (#7618)
3854c9d07f67de7f8cd6d86117bfaef47549b05a	eb57fee51f7b4d78039f003249873c2eb46f12f6	2024-05-30T14:19:08+08:00	Meng, Hengyu		[SYCL] fix intel docker (#7630)
e2b065071c5fc8ac5697d12ca343551faee465cc	0548a4187f2e53b8fc6d9ff0f4c71988f708ff42	2024-05-28T17:53:37+08:00	Neo Zhang		[SYCL]fix ggml_sycl_mul_mat_id() to match the change of api (#7436)
9335b969e86a222e247adacedf814d8abfff8847	c41767154eb82aa3fe7568fc816c3402b78eae94	2024-05-28T06:55:51+02:00	mgroeber9110		server: do not remove whitespace at the start of a completion chunk (#7524)
b9adcbbf92fc7096bee23fe61496d25652ebf765	9588f196b1d7b21bdff013fcf958c249576b2619	2024-05-26T06:26:34+05:30	HanishKVC		SimpleChat Completion Mode flexibility and cleanup, Settings gMe, Optional sliding window (#7480)
27891f6db03de6e3fd5941983838c29bef253352	fbca2f27fc7fa9aa4a8ad0357478fdb908472908	2024-05-24T23:47:56+10:00	Brian		docker.yml: disable light-intel and server-intel test (#7515)
fbca2f27fc7fa9aa4a8ad0357478fdb908472908	0df0aa8e43c3378975269a51f9b876c8692e70da	2024-05-24T14:31:13+02:00	fairydreaming		Add support for ArcticForCausalLM (#7020)
3015851c5ac7334fb544a23a70a284c117b87044	55ac3b7aeaf52f19786ed96e885d89521fc0f6c8	2024-05-23T14:29:26+02:00	Daniel Bevenius		llama : add getters for n_threads/n_threads_batch (#7464)
1e374365d170b7f692fd7753c145e21bc14486c8	197ff91462dd05bb9a3be03578114abf0c355536	2024-05-22T23:23:21+05:30	HanishKVC		SimpleChat: a simple and dumb web front end for testing /chat/completions and /completions end points and try chat (#7350)
201cc11afa0a1950e1f632390b2ac6c937a0d8f0	6369bf04336ab60e5c892dd77a3246df91015147	2024-05-22T04:28:32+08:00	liuwei-git		llama : add phi3 128K model support (#7225)
d7e852c1bc8e85bf62a6f1aede08cd2de723404a	917dc8cfa67a72fb7c8bf7392270da3bf4833af4	2024-05-21T14:39:48+02:00	jaime-m-p		Tokenizer SPM fixes for phi-3 and llama-spm (bugfix) (#7425)
917dc8cfa67a72fb7c8bf7392270da3bf4833af4	fabf30b4c4fca32e116009527180c252919ca922	2024-05-20T20:15:57+02:00	jaime-m-p		Tokenizer SPM fixes for phi-3 and llama-spm (#7375)
3bc10cb485dd7efa4da6c64e73ad0c9e2bfe0821	6bf9b66fa3f263ca2175dcb5f6d0a658581e1dfb	2024-05-20T15:10:03+03:00	Georgi Gerganov		server : fix temperature + disable some tests (#7409)
1cc0155d04918cb3017afa472acea51b77483c4a	e932094d58f513d5996c3efc9f6fed8238894c57	2024-05-20T10:16:41+03:00	Georgi Gerganov		server : tuning tests (#7388)
e932094d58f513d5996c3efc9f6fed8238894c57	2789baf480ba7dc9281b65f601f0918e58920f54	2024-05-20T08:56:05+03:00	Georgi Gerganov		server : return error on too large embedding input (#7389)
1b01f06db0cff5f5f600bb754fc39fde565ed56a	41858392e17abead21735309bf17cb55183d8c31	2024-05-19T16:26:02+02:00	Johannes Gäßler		server: add test for token probs (#7347)
41858392e17abead21735309bf17cb55183d8c31	6aade19ee74b896c59929676629340b36be3e22c	2024-05-19T16:06:33+02:00	Johannes Gäßler		server: fix seed being reported back (#7382)
cb42c294279bc4a0a4e926a7b5a5568049f12fa7	d233b507cd19fcc2d8d8963ecc6a3eb7a33f2ecc	2024-05-18T11:10:47+02:00	Johannes Gäßler		server: correct --threads documentation [no ci] (#7362)
f4bd8b3d260bb09491ba63c77ab7012b744362ef	51e9d02599336e62948d29f1d6c05addeb921ac2	2024-05-17T17:25:44+03:00	Radoslav Gerganov		rpc : set SO_REUSEADDR for the server socket (#7320)
d273c1402b25086fd91aef2467ac13f2e49fa0ea	27b040691cbe45314147c2745e891a38e9c048d4	2024-05-17T15:11:45+03:00	Aarni Koskela		py : convert-hf-to-gguf-update improvements (#7340)
27b040691cbe45314147c2745e891a38e9c048d4	29c60d8cddcfd14fa8a6bf023a6c4eb8692c76ba	2024-05-17T13:24:38+02:00	fairydreaming		llama : use n_embd_head_v when reshaping kqv (#7327)
ee94172d33399d2e814ca05c8a3ff8c523ebb093	934266c0e0b2aa9781fdba2deb112c161ff038a9	2024-05-17T10:00:17+03:00	Radoslav Gerganov		server : add support for the RPC backend (#7305)
9c4fdcbec8c7fcc428e723b0d8a1cf1f351ba642	24ecb58168dce81646c2ed425690a106591c8c6d	2024-05-17T02:11:03+02:00	Leon Knauer		[Server] Added --verbose option to README [no ci] (#7335)
24ecb58168dce81646c2ed425690a106591c8c6d	9afdffe70ebf3166d429b4434783bb0b7f97bdeb	2024-05-16T20:43:45+02:00	Pierrick Hymbert		Revert "server bench: fix bench not waiting for model load (#7284)" (#7334)
583fd6b000ec9ad1b465b5c98524f4a0ae388077	9f773486ab78d65f5cca3f7e31c862b7043bf721	2024-05-15T08:44:16+02:00	Johannes Gäßler		server bench: fix bench not waiting for model load (#7284)
4f0263633b40e94e8b69fd6e7e4395cfedfd5c12	1265c670fd8e41e1947352c96c5179adda97fb2c	2024-05-14T10:11:24-04:00	Steve Grubb		server: free sampling contexts on exit (#7264)
5e31828d3e35c76ecfee665bc23771a4bec1d130	541600201e6480f54ae09e58d16b154d4b4b331d	2024-05-14T14:27:19+03:00	Radoslav Gerganov		ggml : add RPC backend (#6829)
541600201e6480f54ae09e58d16b154d4b4b331d	efc8f767c8c8c749a245dd96ad4e2f37c164b54c	2024-05-14T09:33:42+02:00	slaren		llama : disable pipeline parallelism with nkvo (#7265)
e586ee42595500c53938e937b6b6ad5353ad76dc	cbf75894d256f1861f6409565db599365de3d4b8	2024-05-12T19:40:08-07:00	Benjamin Findley		change default temperature of OAI compat API from 0 to 1 (#7226)
cbf75894d256f1861f6409565db599365de3d4b8	0d5cef78aeafae4d4e6d56e2d4bcda771af58cc9	2024-05-13T08:04:29+08:00	Neo Zhang		[SYCL] Add oneapi runtime dll files to win release package (#7241)
0d5cef78aeafae4d4e6d56e2d4bcda771af58cc9	dc685be46622a8fabfd57cfa804237c8f15679b8	2024-05-13T08:02:55+08:00	Neo Zhang		[SYCL] update CI with oneapi 2024.1 (#7235)
988631335a20d06497f58be0b8ba13adb4323a22	f99e1e456eaf69cc38c1982a2693ce41c0f897ef	2024-05-11T04:13:02-04:00	Steve Grubb		server : free llama_batch on exit (#7212)
5ae3426b0b64672991563d4c28b2018b9f961467	b83cc3f5b303ff30c52874b2d5864dc6385ebf9f	2024-05-11T10:11:28+02:00	Johannes Gäßler		server: fix reported top tokens for temperature 0 (#7203)
4e3880978f8b1bf546dd4e6f3b524d6b8739c49c	f89fe2732c5709f6e86d5f4aee2e6d2a561f2eb2	2024-05-10T07:01:08-04:00	Justine Tunney		Fix memory bug in grammar parser (#7194)
d46dbc76f8770caec0175f1e57777173c70556a0	0961d866044143eefec5b525e991611f73fd4f6e	2024-05-09T16:40:42+03:00	Georgi Gerganov		readme : add scheduled server workflow status badge
47345248827f426038098d016ed11975021b4919	07cd41d0965829463eff73eda3348aedbfd3a444	2024-05-09T17:34:37+08:00	Albert Jin		opencl : alignment size converted from bits to bytes (#7090)
bd1871fa2b1bf8a081b43ba9bc85f8ffd46fac46	26458af1d63c85195cd96cd1673051e332d06d30	2024-05-08T20:12:06+01:00	JohnnyB		server : add themes + favicon (#6848)
911b3900dded9a1cfe0f0e41b82c7a29baf3a217	ad211edef5db1f1fb955874b7ca6a67bd0c88708	2024-05-08T14:27:58+02:00	Johan		server : add_special option for tokenize endpoint (#7059)
1fd9c1741d864d01cd7ec6d67227b92d7bfabf22	4cd621c26de2095cd7c4464bdec5fe2e696ef3f3	2024-05-08T13:24:14+02:00	Xuan Son Nguyen		clean up json_value & server_log (#7142)
3855416027cb25d9a708ffa5581cf503a87856a6	c0e6fbf8c380718102bd25fcb8d2e55f8f9480d1	2024-05-08T02:30:09-04:00	Justine Tunney		ggml : introduce bfloat16 support (#6412)
af0a5b616359809ce886ea433acedebb39b12969	b6aa6702030320a3d5fbc2508307af0d7c947e40	2024-05-07T23:07:58+02:00	Johannes Gäßler		server: fix incorrectly reported token probabilities (#7125)
260b7c65296fba0568eeb1ff05244ea0be206b54	53d6c52e227dedef347b21e28febcfb9caeecdad	2024-05-07T13:44:29-05:00	Kyle Mistele		server : update readme with undocumented options (#7013)
8f8acc8683a00ce40fa5a81161a079d2167126e6	ca3632602091e959ed2ad4c09c67a7c790b10d31	2024-05-05T13:38:55+02:00	Sigbjørn Skjæret		Disable benchmark on forked repo (#7034)
cf768b7e71cbcc9886c753ae963c2b68893d02e4	fcd84a0f5a584ab5271745d7ffef21c8a6bc7b0c	2024-05-04T13:10:15-03:00	Jeximo		Tidy Android Instructions README.md (#7016)
03fb8a002df2e96104f9e06de9c78d2a8ed91e92	92139b90af4841d7fd060b526bdd443b621770ff	2024-05-04T12:06:40+03:00	maor-ps		If first token generated from the server is the stop word the server will crash (#7038)
3ea0d36000e2314baba7e9fc6a97f08670a6f7e4	1613ef8d8eb2479ba55c4d598e08c8f3f18a0fed	2024-05-01T17:52:55+02:00	Johannes Gäßler		Server: add tests for batch size, different seeds (#6950)
9c67c2773d4b706cf71d70ecf4aa180b62501960	952d03dbead16e4dbdd1d3458486340673cc2465	2024-04-30T12:16:08+03:00	Georgi Gerganov		ggml : add Flash Attention (#5021)
8843a98c2ba97a25e93319a104f9ddfaf83ce4c4	b8c1476e44cc1f3a1811613f65251cf779067636	2024-04-30T00:52:50+01:00	Olivier Chafik		Improve usability of --model-url & related flags (#6930)
b7368332e24c5b2c8038bf8267f43632783fcc35	928e0b7013c862cf10701957b3d654aa70f11bd8	2024-04-27T17:50:48+02:00	Pierrick Hymbert		ci: server: tests python env on github container ubuntu latest / fix n_predict (#6935)
928e0b7013c862cf10701957b3d654aa70f11bd8	0c4d489e29e53589bf13a801fe7c94b7b546d8f6	2024-04-26T19:08:30+01:00	agray3		Reset schedule earlier to allow overlap with ggml graph computation on device (#6933)
0c4d489e29e53589bf13a801fe7c94b7b546d8f6	017e6999b5184234370b22a2f868e1be911e8d88	2024-04-26T20:06:33+02:00	Pierrick Hymbert		quantize: add imatrix and dataset metadata in GGUF (#6658)
bbe3c6e76157a5d806fdc155451f0ca8936248ee	7f5ff558eed0f732af8f25c2ab0645610bdec80c	2024-04-26T12:27:25+02:00	Pierrick Hymbert		ci: server: fix python installation (#6925)
7f5ff558eed0f732af8f25c2ab0645610bdec80c	9e4e077ec50fde6049b128662c72d37a3c28e34b	2024-04-26T12:15:30+02:00	Pierrick Hymbert		server: stop generation at `n_ctx_train` if `n_predict` is not set (#6638)
9e4e077ec50fde6049b128662c72d37a3c28e34b	83b72cb086ce46a33dececc86bfe4648b6120aa8	2024-04-26T11:11:51+02:00	Pierrick Hymbert		ci: server: fix python installation (#6922)
83b72cb086ce46a33dececc86bfe4648b6120aa8	d4a9afc1009f0da88d04b2c5f672d81d5ae94675	2024-04-26T10:41:53+03:00	Georgi Gerganov		Merge pull request from GHSA-p5mv-gjc5-mwqv
d4a9afc1009f0da88d04b2c5f672d81d5ae94675	7d641c26ac73956a54b204cabefe85c764823678	2024-04-26T09:27:49+02:00	Pierrick Hymbert		ci: server: fix python installation (#6918)
7d641c26ac73956a54b204cabefe85c764823678	5790c8dac1a4f0aa80b4efee3b962d8c04c829e8	2024-04-26T09:26:59+02:00	Pierrick Hymbert		ci: fix concurrency for pull_request_target (#6917)
5790c8dac1a4f0aa80b4efee3b962d8c04c829e8	46e12c4692a37bdd31a0432fc5153d7d22bc7f72	2024-04-26T09:26:16+02:00	Pierrick Hymbert		bench: server add stop word for PHI-2 (#6916)
3fe847b5747676ee1bf90371c46ed0bc66b57240	37246b1031b1680c0dcaf20aef736d6b446203fa	2024-04-24T12:54:24+02:00	mgroeber9110		server : do not apply Markdown formatting in code sections (#6850)
37246b1031b1680c0dcaf20aef736d6b446203fa	28103f4832e301a9c84d44ff0df9d75d46ab6c76	2024-04-24T05:15:29-05:00	Kyle Mistele		common : revert showing control tokens by default for server (#6860)
28103f4832e301a9c84d44ff0df9d75d46ab6c76	c0d1b3e03e27634ac2871761f5033cf9324d472d	2024-04-24T11:08:36+02:00	Johannes Gäßler		Server: fix seed for multiple slots (#6835)
5cf5e7d490dfdd2e70bface2d35dfd14aa44b4fb	40f74e4d739e9250431cf339ae7588b28d8d0663	2024-04-21T18:48:53+01:00	Olivier Chafik		`build`: generate hex dump of server assets during build (#6661)
40f74e4d739e9250431cf339ae7588b28d8d0663	b9cc76d87e3d7ae5900f19d4fe8f8976d0a35888	2024-04-21T18:36:45+03:00	Georgi Gerganov		llama : add option to render special/control tokens (#6807)
b8109bc0139f15a5b321909f47510b89dca47ffc	aed82f6837a3ea515f4d50201cfc77effc7d41b4	2024-04-21T00:29:50+08:00	Jan Boon		doc : server tests require llama to be built with curl enabled (#6788)
637e9a86c220718d008b54842dfd294aa96d3b7a	9958c81b798a5872087b30b360e4674871f2479e	2024-04-19T13:19:01+02:00	Pierrick Hymbert		server: static: upstream upgrade (#6765)
3272896d79465fd2befef3425dac8e83933b7ea4	7fc16a2c32650d46e79b382ecc6720f58c82f31b	2024-04-15T14:18:47+02:00	Pierrick Hymbert		server : revert "minor layout improvements" (#6684)
ab9a3240a9da941fdef5cd4a25f2b97c2f5a67aa	fbbc030ba93561fac842af994c5c6c4c1147f13b	2024-04-12T19:43:38+01:00	Olivier Chafik		JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)
24ee66ed0d908d156bd0d1747b63a636a495cd7a	91c736015b66ba1d0b82cbae6313b6d5eaa61b68	2024-04-12T13:49:21+02:00	Pierrick Hymbert		server : coherent log output for KV cache full (#6637)
cbaadc92942c50aab599a9e4c163afc1f44f7c26	1bbdaf6ecda6f0a360dfb307b256fcb6838c560b	2024-04-11T19:47:34+01:00	Olivier Chafik		grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609)
400d5d722d7edf7de0cf24a18c42b183c65047d2	5dc9dd7152dedc6046b646855585bd070c91e8c8	2024-04-09T01:31:47-07:00	Ed Lee		server : detect search query to start webchat (#6554)
e3c337d87ca650972105a51c6ce302dd236c07ad	beea6e1b16e783a0886e78dec01002a8c00db24d	2024-04-08T06:02:30-07:00	Rick G		llama : support negative ith in llama_get_ API (#6519)
beea6e1b16e783a0886e78dec01002a8c00db24d	87fb5b4234d4b9c56ac94cf7aa229c8fd7defdb0	2024-04-08T20:43:30+08:00	Jan Boon		llama : save and restore kv cache for single seq id (#6341)
b66aec675c1571a06b3570b858ae711246f96f84	57dd02c44b2a0eb79e28f6c5eb8242a5d2d3174d	2024-04-03T22:57:20+02:00	Daniel Bevenius		backend : fix typo in scheduler documentation (ggml/781)
57dd02c44b2a0eb79e28f6c5eb8242a5d2d3174d	75cd4c77292034ecec587ecb401366f57338f7c0	2024-04-06T10:31:33-04:00	Clint Herron		Tests: Added integration tests for GBNF parser  (#6472)
75cd4c77292034ecec587ecb401366f57338f7c0	a8bd14d55717754a1f48313a846a2b16fa998ad2	2024-04-06T05:40:47+02:00	Pierrick Hymbert		ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response (#6495)
0a1d889e27d6aaa3293dd2c692b849a9bcf4b474	7dda1b727ef1730783a6077136d28b83e70dd397	2024-04-04T17:31:22+01:00	Ed Lepedus		server: add cURL support to server Dockerfiles (#6474)
2e66913e5f56209f4c949f98e431925b78e7e84d	8120efee1d9931b514aeb5a047209d576f23286c	2024-04-04T11:03:00-04:00	Shakhar Dasgupta		server: allow penalizing repetition of newlines on server webpage (#6431)
7a2c92637ae265654a68f62e6a7610b358255d3f	4bcd6b959ca3991084ad1d8464caf2a734e29b1d	2024-04-04T11:57:58+02:00	Pierrick Hymbert		ci: bench: add more ftype, fix triggers and bot comment (#6466)
4399f13fb9462cd06f3f154d0aee738425000fea	1a43c7254ed5de91d09274b853db843c518f1b64	2024-04-04T09:34:58+03:00	Georgi Gerganov		server : remove obsolete --memory-f32 option
1a43c7254ed5de91d09274b853db843c518f1b64	72d73af65132792a52433952ca4729b01c36cde2	2024-04-04T01:33:48-05:00	Xiao-Yong Jin		server : add option to disable KV offload (#6468)
5fb1574c8112c757fc202fdae279da883f34e610	60cdf40cc32f0ad4cb11e0ca8fd38f3b93d8d640	2024-04-03T13:22:57-07:00	Fattire		A few small fixes to server's README docs (#6428)
60cdf40cc32f0ad4cb11e0ca8fd38f3b93d8d640	bb43cf7e9d86d69ffd9c7f008f75db890a35b45a	2024-04-03T20:09:52+02:00	JH23X		server : handle exception on wrong type in request (#6452)
5d4f12e4624bf4435ba26753814bedd4e9b62803	154d4ee39c38e231fb5c3910df14d2fc920fdf1b	2024-04-03T18:56:37+01:00	Ed Lepedus		server: add cURL support to `server.Dockerfile` (#6461)
226e819371eec0f298d9075198394a07b23ecfa9	c50a82ce0f71558cbb8e555146ba124251504b38	2024-04-01T12:36:40+02:00	Pierrick Hymbert		ci: server: verify deps are coherent with the commit (#6409)
057400a3fd457f4f214684eeb171444663b47a23	b75c38166cf0c66793a32d5c3d6cb69929dd083d	2024-03-29T08:23:22+01:00	Daniel Bevenius		llama : remove redundant reshape in build_kv_store (#6369)
28cb9a09c4d10a489be1238abe7a858dcd4d65f2	cfc4d75df6399b36153ef739f2c1abee4c114bb8	2024-03-28T11:27:56+01:00	Pierrick Hymbert		ci: bench: fix master not schedule, fix commit status failed on external repo (#6365)
6902cb7f2e3479f364ee177118200fb7e4e9fc92	d2d8f389960a106b66313ff1621bdb1aaaaaa285	2024-03-28T16:50:48+08:00	Eric Zhang		server : stop gracefully on SIGTERM (#6348)
a016026a3ac16d8c9b993a3573f19b9556d67de4	53c7ec53d5eca26b2c0c648605543a5fa6c12817	2024-03-27T20:26:49+01:00	Pierrick Hymbert		server: continuous performance monitoring and PR comment (#6283)
1740d6dd4e00dedda87d6820b0e0d8e70dade340	0642b22cd12af278d6e7e459b73411947c169381	2024-03-27T08:08:59+01:00	Mateusz Charytoniuk		readme : add php api bindings (#6326)
0642b22cd12af278d6e7e459b73411947c169381	a4f569e8a316cbd33d2b4de94b694d111507475a	2024-03-27T13:55:29+08:00	Eric Zhang		server: public: use relative routes for static files (#6325)
557410b8f06380560155ac7fcb8316d71ddc9837	55c1b2a3bbd470e9e2a3a0618b92cf64a885f806	2024-03-26T10:46:41-04:00	compilade		llama : greatly reduce output buffer memory usage (#6122)
3d032ece8e6973441273601ca2981130608e287d	e190f1fca6f60d80944f9e8709d343a025c4d245	2024-03-26T16:47:43+08:00	Jan Boon		server : add `n_discard` parameter (#6300)
ad3a0505e3b6cd777259ee35e61d428357ffc565	95ad616cddda50273e955bfe192328acd9aa4896	2024-03-25T09:42:17+01:00	Xuan Son Nguyen		Server: clean up OAI params parsing function (#6284)
ddf65685105a39a57b1e7f80c3aa502a6313af24	d03224ac9840351023ff8abcf4aa0542258a53df	2024-03-24T12:04:25+08:00	Meng, Hengyu		[SYCL] offload op (#6217)
f482bb2e4920e544651fb832f2e0bcb4d2ff69ab	1997577d5e121568ae39f538021733ccd4278c23	2024-03-23T18:07:00+01:00	Pierrick Hymbert		common: llama_load_model_from_url split support  (#6192)
1997577d5e121568ae39f538021733ccd4278c23	476b0251b27fb64c575507024a671e639d675594	2024-03-23T18:00:38+01:00	Pierrick Hymbert		server: docs: `--threads` and `--threads`, `--ubatch-size`, `--log-disable` (#6254)
1b26aebe4de4f048ac99996efd8a2c9af150904d	50ccaf5eacb50a2ca378a4ef0dc7aeb45fead652	2024-03-23T13:18:45+01:00	Pierrick Hymbert		server: flush stdout after logging in both text and json layout (#6253)
72114edf068a9b2f54d3b09e9a198f611be397e8	2f0e81e053b41ca28e73a841e7bdbf9820baaa57	2024-03-22T13:07:44Z	Olivier Chafik		json-schema-to-grammar : fix order of props + non-str const/enum (#6232)
6b8bb3a31d260a01020497c5f01025c34222fcb9	68e210b3543e0cc71268bee0920441747679ee13	2024-03-22T19:12:05+08:00	Jan Boon		server : fix n_keep always showing as 0 in response (#6211)
68e210b3543e0cc71268bee0920441747679ee13	b3e94f26bab8e3b5338b5902e5af5bb01894cb4a	2024-03-22T13:08:28+02:00	Georgi Gerganov		server : enable continuous batching by default (#6231)
be07a03217376c53b1d95e5f658adbbbb2831555	d0a71233fbf8ade8ef06ad8e6b81d1d7b254895f	2024-03-22T06:41:24+08:00	Jan Boon		server : update readme doc from `slot_id` to `id_slot` (#6213)
f372c49ccdc561ab96fb3c7d2b7cbc0f89a4b359	924ce1dce7fdf54894b462d03e7b608a6e574c32	2024-03-21T11:52:35-06:00	semidark		Corrected typo to wrong file (#6199)
5b7b0ac8dfdd800c0fd0dc69b69991e8cb19fb46	1943c0198125a0da1a200390e82cf461f9080d99	2024-03-21T11:50:43Z	Olivier Chafik		json-schema-to-grammar improvements (+ added to server) (#5978)
91f8ad167dcd24b54615b468d9dd764ebe1d37ad	6b7e76d28cdf4361740054140708c71828453522	2024-03-20T13:30:36+01:00	Xuan Son Nguyen		Server: version bump for httplib and json (#6169)
bc0baab2ea8f806961dd3fb9f534cfeb59a2e1fc	d795988d9e09f75412efe2134512914c42780ad5	2024-03-20T14:14:32+02:00	Georgi Gerganov		server : allow to override -ngl in tests (#6170)
47cc7a7bf9793f81a6dfe7c2096c499403f64dd6	bd60d82d0cc8b6852ec535495a5042dbdf05de24	2024-03-20T16:32:34+05:30	Karthick		Server: Handle n_keep parameter in the request (#6174)
bd60d82d0cc8b6852ec535495a5042dbdf05de24	6c0b287748327741b113d7d6018b68c63039b1c5	2024-03-20T01:33:49-04:00	Jared Van Bortel		server tests : more pythonic process management; fix bare `except:` (#6146)
a56d09a4407f29c21e149b44fd5308f83aa1cb09	d84c48505f60bcd358b82a751d40418c4d235643	2024-03-16T13:20:53+01:00	Pierrick Hymbert		ci : close inactive issue with workflow (#6053)
877b4d0c628cc70dddb5df72ed8fc14d126ca7e8	12247f4c69a173b9482f68aaa174ec37fc909ccf	2024-03-15T13:43:02-07:00	Theia Vogel		llama : add support for control vectors (#5970)
12247f4c69a173b9482f68aaa174ec37fc909ccf	4e9a7f7f7fb6acbddd1462909c8d696e38edbfcc	2024-03-15T16:41:22-04:00	Andrew Canis		llama : add Command-R support (#6033)
4e9a7f7f7fb6acbddd1462909c8d696e38edbfcc	3020327f6cd6d2ce50528dd65f4b199d2ea8b1ae	2024-03-15T22:31:05+08:00	Ting Lou		llava : change API to pure C style for Rust FFI bindgen (#6079)
43241adf22e8231ffaf3827d2c9310cc0ffd5ac5	a44bc969e4cd62ca9f4332e17fe3c51f2093e7c6	2024-03-14T12:15:39+01:00	Pierrick Hymbert		server: disable debug release type sanitizer, simplify trigger (#6047)
76a936c8939c249a7c3e8e66dfefbab13eae194f	463628372d5fe3a0c1e5864aa5fc57deb7387039	2024-03-13T20:33:56+02:00	Georgi Gerganov		readme : update API changes and hot topics
f30ea47a87ed4446ad55adb265755dc9102956a2	d8fd0ccf6ac8b07791ffd1575eed436930854ae3	2024-03-13T18:54:21+01:00	slaren		llama : add pipeline parallelism support (#6017)
99b71c068f624521ad977e08e41589e2971fa1c7	306d34be7ad19e768975409fc80791a274ea0230	2024-03-13T11:39:11+01:00	Xuan Son Nguyen		Server: Use multi-task for embeddings endpoint (#6001)
05b06210c954491cf0f12034b0a62bd4d69ce78b	83796e62bc9f6caae6228168e359890f51e60fee	2024-03-11T17:49:47+02:00	Georgi Gerganov		llama : more consistent names of count variables (#5994)
83796e62bc9f6caae6228168e359890f51e60fee	828defefb66fc8a25404f5de845897145bf34061	2024-03-11T17:47:47+02:00	Georgi Gerganov		llama : refactor unicode stuff (#5992)
828defefb66fc8a25404f5de845897145bf34061	caa106d4e05a0ab94225c220b81f9e2cd522339b	2024-03-11T14:40:42+01:00	Jakub N		Update server docker image URLs (#5997)
caa106d4e05a0ab94225c220b81f9e2cd522339b	3202361c5b1ba15e695b31209567ef42c22c5c32	2024-03-11T10:56:41+01:00	Xuan Son Nguyen		Server: format error to json (#5961)
332bdfd7980718abf664bfa5460f2288a3314984	ecab1c75de68de7c41c254e2ae170d3b07bee6d4	2024-03-11T17:09:32+09:00	Minsoo Cheong		server : maintain chat completion id for streaming responses (#5988)
fa8a809a9119411bc9c3f00026550d0343f4d9b7	bcebd7dbf62fd7b293d5ed089023e4e733269c71	2024-03-10T18:17:47+01:00	Pierrick Hymbert		server: ci: windows build and tests (#5968)
621e86b331f8b0e71f79fd82a4ae1cd54c3e4396	77d1ac7e00bf049b9f2bba1b5a310a78318c49c4	2024-03-09T23:41:49+01:00	Pierrick Hymbert		server: benchmark: chat/completions scenario and other llm servers comparison (#5941)
77d1ac7e00bf049b9f2bba1b5a310a78318c49c4	d894f352bf433157232dc8dc54eacd50014e898e	2024-03-09T22:04:00+02:00	Georgi Gerganov		server : print chat template info
d894f352bf433157232dc8dc54eacd50014e898e	098dbaab449f5309a54871ba7e5acef72ae696de	2024-03-09T19:55:54+01:00	slaren		perplexity : support using multiple sequences to allow larger batch sizes (#5946)
58308a0ecce7cc261b802f4803c38d420063db21	5b09797321430f08caf0473143a962916ab2ea89	2024-03-09T17:34:15+02:00	Georgi Gerganov		server : fix metrics init (#5964)
5b09797321430f08caf0473143a962916ab2ea89	97c09585d65a95864773b4d25d66d0f708baf38d	2024-03-09T15:53:59+02:00	Georgi Gerganov		ggml : remove old quantization functions (#5942)
97c09585d65a95864773b4d25d66d0f708baf38d	fb215c3832236fec7380c4fb618bd7154cb196ef	2024-03-09T15:47:47+02:00	Georgi Gerganov		server : clarify some items in the readme (#5957)
fb215c3832236fec7380c4fb618bd7154cb196ef	2c4f566c88322ebf2f9bd11b01b5ebdaa0130b89	2024-03-09T21:27:58+09:00	SeungWon Jeong		server : normalize embeddings (#5956)
0db32beaf09d90b8959d3d0cc493ed1e45685353	8a3012a4ad08112bb3dc3f1399afec4e93780c44	2024-03-09T11:16:53Z	Alexey Parfenov		server : fix passing prompt as tokens (#5955)
9674aaf35cb81478eb38c3f3ebde713ec72fbb79	950ba1ab84db199f0bbdecdb2bb911f35261b321	2024-03-09T12:34:18+02:00	Georgi Gerganov		server : simplify logic for empty prompts (#5953)
950ba1ab84db199f0bbdecdb2bb911f35261b321	e1fa9569ba8ce276bc7801a3cebdcf8b1aa116ea	2024-03-09T11:27:53+01:00	Xuan Son Nguyen		Server: reorganize some http logic (#5939)
e1fa9569ba8ce276bc7801a3cebdcf8b1aa116ea	fd72d2d2a5e79d61ccef6af3d15f16e5e5cbc352	2024-03-09T02:57:09-07:00	Gabe Goodhart		server : add SSL support (#5926)
fd72d2d2a5e79d61ccef6af3d15f16e5e5cbc352	c2101a2e909ac7c08976d414e64e96c90ee5fa9e	2024-03-09T10:30:04+01:00	Pierrick Hymbert		server: tests: add truncated prompt tests, better kv cache size (#5933)
c2101a2e909ac7c08976d414e64e96c90ee5fa9e	515f7d0d4fce41c752fc253acf30707c3be2531e	2024-03-08T17:31:00-05:00	compilade		llama : support Mamba Selective State Space Models (#5328)
76e868821a94072fbc87cb1fcca291694319eae8	e457fb3540e0aaec47cfde0abf784c213f9216ee	2024-03-08T12:25:04+01:00	Pierrick Hymbert		server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predicted_seconds_total, reset bucket only on /metrics. Fix values cast to int. Add Process-Start-Time-Unix header. (#5937)
af37fd8b30e37ccbffdd82e6f48559e2fb7ce7dd	581ed5c4fe3a8909aaa8313633ac443f471ba755	2024-03-08T12:40:02+02:00	Georgi Gerganov		server : fix EOS token detection with disabled cache (#5938)
55a2a900ff4a02fc33708ac7858d595d289a3f2a	2002bc96bf2cbf5ab981a17d7e994d817c9801f5	2024-03-07T19:42:39+09:00	Minsoo Cheong		server : add `/v1/completions` endpoint (#5914)
2002bc96bf2cbf5ab981a17d7e994d817c9801f5	ceca1aef0738b57951cd12c603c3477e75312dec	2024-03-07T11:41:53+02:00	Georgi Gerganov		server : refactor (#5882)
21b08674331e1ea1b599f17c5ca91f0ed173be31	6a87ac3a52668e117d97bcea07b529c93188b303	2024-03-05T16:08:35+08:00	Neo Zhang Jianyu		[SYCL] fix mul_mat fault in CI/unit-test (#5862)
29ae62d2ae163e2b68aa0ad3bf2ab4636de0c957	e0843afe1b37890b631bc7d3d2da2ed36c862b91	2024-03-04T22:31:20+02:00	Georgi Gerganov		llama : fix embeddings (#5796)
231ae28f078c3148d097b301f2145f1e3e816cc1	475df1d6cf817060028d3ff763cb8097d4ec40d6	2024-03-03T12:44:03+02:00	Georgi Gerganov		readme : add API changes section
e6029348e86c3810d4435faee54ba822cb43e2ef	8ef969afcec1645d2d9c3ab1fc82263bba968989	2024-03-03T09:35:23+01:00	Pierrick Hymbert		ci : schedule slow server tests only on Release or on demand (#5839)
8ef969afcec1645d2d9c3ab1fc82263bba968989	fa974646e1a2024fc7dc9e6f27cf1f2f5d4a3763	2024-03-03T08:48:36+01:00	Pierrick Hymbert		server : init http requests thread pool with --parallel if set (#5836)
9731134296af3a6839cd682e51d9c2109a871de5	4a6e2d6142ab815c964924896891e9ab3e050632	2024-03-02T22:00:14+01:00	Pierrick Hymbert		server: tests: passkey challenge /  self-extend with context shift demo (#5832)
38d16b142624bdd7c41d9955752b7f7b59c5e048	c2224f003bf9cf558b1a3c57033563e11a4de9a5	2024-03-01T20:00:58+02:00	Georgi Gerganov		server : remove api_like_OAI.py proxy script (#5808)
5cb02b4a012bb16c6c699c0c62c05ffa653eee0f	6ea0f010ff6967034528d9e0b8330b9b0f0b7c13	2024-03-01T10:08:08+01:00	Pierrick Hymbert		server: allow to override threads server pool with --threads-http (#5794)
f105471ef6aa4727afac8240da398590d7277f45	38d152160898b0173ffe4dc7df5daadcbd2eceb0	2024-03-01T09:59:43+02:00	Georgi Gerganov		server : fix newlines in help (#5785)
052051d8ae4639a1c3c61e7da3237bcc572469d4	d5ab29757ebc59a30f03e408294ec20628a6374e	2024-02-29T21:42:11+01:00	Xuan Son Nguyen		Server: normalize naming (#5779)
08c5ee87e4cceb603ecceac90734fcdade57311b	78aacf36344df724cdca9f1e1af849b2d2519cb8	2024-02-28T18:43:38+02:00	Georgi Gerganov		llama : remove deprecated API (#5770)
a693bea1e6762a17b78b6ddf4611e54136941ea2	adcb12a9bad87bc96f2f158c95892b3d04aa7ffb	2024-02-28T09:55:37+01:00	Xuan Son Nguyen		server : hit Ctrl+C twice to exit (#5734)
efc72253f7987ed7bdc8bde9d9fa5c7cac2f6292	7c4263d4261d6ee6f0539d53eb9e1b4d120ba8af	2024-02-28T01:39:15-07:00	Jorge A		server : add "/chat/completions" alias for "/v1/...` (#5722)
b11a93df41921846a10628a7c306d5c82a549939	a33e6a0d2a66104ea9a906bdbf8a94d050189d91	2024-02-26T23:15:48+01:00	Xuan Son Nguyen		fix server hangs on empty prompt (#5733)
4804215cb833841ffb15a710a16b77ca0a29eb4b	8a533f0d9078396ebaee9ba213038a1322976dee	2024-02-26T11:41:34+01:00	Pierrick Hymbert		server: CI fix trailing space (#5728)
8a533f0d9078396ebaee9ba213038a1322976dee	269de86ba073b5dc9ce687c11a3bc4d7d873b962	2024-02-26T09:56:10+01:00	Pierrick Hymbert		server: CI tests reduce build matrix (#5725)
e3965cf35aac00d4e24998c8a3d0093ae1d98bd3	8b350356b28f782deab63d8b0e9ae103ceb25fcd	2024-02-25T22:48:33+01:00	Pierrick Hymbert		server: tests - slow inference causes timeout on the CI (#5715)
8b350356b28f782deab63d8b0e9ae103ceb25fcd	bf08e00643fd529f748f0a858fd79f3061e3fa18	2024-02-25T21:46:29+01:00	Pierrick Hymbert		server: docs - refresh and tease a little bit more the http server (#5718)
f7625019c51ca437a5840576d92362cfa710e4a2	abbabc5e51d0d4656b438aec10b7fae9479ef37d	2024-02-25T13:43:50-05:00	compilade		server : fix crash when system prompt is bigger than batch size (#5714)
930b1780269a69948d106e2d1b838ab7661f679a	d52d7819b8ced70c642a88a59da8c78208dc58ec	2024-02-25T13:50:32+01:00	Pierrick Hymbert		server: logs - unified format and --log-format option (#5700)
d52d7819b8ced70c642a88a59da8c78208dc58ec	12894088170f62e4cad4f8d6a3043c185b414bab	2024-02-25T13:49:43+01:00	Pierrick Hymbert		server: concurrency fix + monitoring - add /metrics prometheus compatible endpoint (#5708)
9e359a4f47c1b2dceb99e29706c9f7403d32ab5e	4c4cb30736582cacb1a164a9d4bc8e17b1014be7	2024-02-24T19:16:04+01:00	Pierrick Hymbert		server: continue to update other slots on embedding concurrent request (#5699)
525213d2f5da1eaf4b922b6b792cb52b2c613368	fd43d66f46ee3b5345fb8a74a252d86ccd34a409	2024-02-24T12:28:55+01:00	Pierrick Hymbert		server: init functional tests (#5566)
fd43d66f46ee3b5345fb8a74a252d86ccd34a409	54fbcd2ce6c48c9e22eca6fbf9e53fb68c3e72ea	2024-02-23T19:31:54Z	AlpinDale		server : add KV cache quantization options (#5684)
a46f50747b2028f7f9c9883b26bfba12bf92556e	c5688c6250430d2b8e0259efcf26c16dfa4c1f46	2024-02-22T09:33:24+01:00	Xuan Son Nguyen		server : fallback to chatml, add AlphaMonarch chat template (#5628)
c5688c6250430d2b8e0259efcf26c16dfa4c1f46	4ef245a92a968ba0f18a5adfd41e51980ce4fdf5	2024-02-22T08:27:32Z	Alexey Parfenov		server : clarify some params in the docs (#5640)
1ecea255ebb70750b52688393f37a63606b90e3f	a00a35cef93e057eace8351a667d14d152a91ebc	2024-02-21T15:47:48+01:00	Pierrick Hymbert		server: health: fix race condition on slots data using tasks queue (#5634)
6560bed3f066c876682464762cad90f1e28e3f1b	06bf2cf8c406e6b70dbf9b431a02fa0ad845b9df	2024-02-20T11:07:22-08:00	CJ Pais		server : support llava 1.6 (#5553)
9c405c9f9a7cfd23511fd6b2de05dc72481119b4	5207b3fbc500f89dfe528693e96540956dbaed96	2024-02-20T15:58:27+01:00	Xuan Son Nguyen		Server: use llama_chat_apply_template (#5593)
c0a8c6db371cb3e4379900867b948879f5842201	b9111bd209c7b11b0592450a6ed2e0ca545b2c84	2024-02-20T08:48:19+01:00	Pierrick Hymbert		server : health endpoint configurable failure on no slot (#5594)
5ee99c32f5e47c8d32634eff9a47fb32a24c276b	c145f8a132b2fe1d1e65987faddbd9a40bef7a12	2024-02-18T11:11:16-08:00	Robey Holderith		common, server : surface min_keep as its own parameter (#5567)
c145f8a132b2fe1d1e65987faddbd9a40bef7a12	689a091bbe0537ee9abff3e15a1d74f5f3561165	2024-02-18T18:39:57+01:00	Pierrick Hymbert		server : slots monitoring endpoint (#5550)
e75c6279d1c8e7abb82a331f5de7124eed402de2	36376abe05a12a8cb3af548a4af9b8d0e2e69597	2024-02-18T17:31:28+01:00	Pierrick Hymbert		server : enhanced health endpoint (#5548)
36376abe05a12a8cb3af548a4af9b8d0e2e69597	66c1968f7a2e895675425e875b6589f1233a1b52	2024-02-18T17:30:09+01:00	Pierrick Hymbert		server : --n-predict option document and cap to max value (#5549)
66c1968f7a2e895675425e875b6589f1233a1b52	1dcc3fde004787e6fc4d84c9de0bb34cd2901a3e	2024-02-18T08:23:16-08:00	Daniel Hiltgen		server : graceful server shutdown (#5244)
6dcc02d2444c779c18d49c364c5d5c5728b6b484	5f5808ca7b7f23a1fa7a77241842bb84a0e55108	2024-02-16T11:33:25Z	Alexey Parfenov		server : add "samplers" param to control the samplers order (#5494)
5f5808ca7b7f23a1fa7a77241842bb84a0e55108	f486f6e1e5e9d01603d9325ab3e05f1edb362a95	2024-02-16T11:00:56+01:00	Rőczey Barnabás		server : fix system prompt cli (#5516)
f486f6e1e5e9d01603d9325ab3e05f1edb362a95	60ed04cf82dc91ade725dd7ad53f0ee81f76eccf	2024-02-16T01:31:07-08:00	bmwl		ggml : add numa options (#5377)
0d4177126b0556e202efb85bf3f768be81076400	7930a8a6e89a04c77c51e3ae5dc1cd8e845b6b8f	2024-02-15T09:01:57+01:00	Elbios		llava : fix memory management bug (#5491)
aa2341298924ac89778252015efcb792f2df1e20	f5ca054855dea83f424003162f26de376e5643f6	2024-02-14T08:38:35+01:00	John		llava : support v1.6 (#5267)
684780141a08200ec98eba3e982dbafd1d0b5000	85910c5b30f6e268321be8df044f5528a6efac52	2024-02-11T13:38:14Z	Alexey Parfenov		server : allow to specify tokens as strings in logit_bias (#5003)
907e08c1109f498b01036367804cff3082c44524	f026f8120f97090d34a52b3dc023c82e0ede3f7d	2024-02-11T11:16:22+01:00	Xuan Son Nguyen		server : add llama2 chat template (#5425)
7c777fcd5dd4af7079e33390cf6a19c328a2666f	e5ca3937c685d6e012ac4db40555d6ec100ff03c	2024-02-09T02:49:49-08:00	Riley Stewart		server : fix prompt caching for repeated prompts (#5420)
0ef46da632c32faa1a538e5dc180994e8bbb46e1	ee1628bdfea8b0079fed0140ac2f00ef1b465b57	2024-02-07T02:17:25-06:00	Xiao-Yong Jin		llava-cli : always tokenize special tokens (#5382)
f3e2b4fa3f81a410ecb7dec929c259ef8d8dbb7d	f68664ac241a6b5c233d8f1051eef20929b06008	2024-02-07T01:15:19-05:00	Justin Parker		server : update `/props` with "total_slots" value (#5373)
213d1439fadefe182f69c5f7e8dd3b4b6572ebcb	17c97fb0620448b37516a3f53fea6c482b0a30a4	2024-02-06T18:08:38Z	Alexey Parfenov		server : remove model.json endpoint (#5371)
8a79c591de9b7ff3242a94f68b7fb5a17ed8c2be	31e790322133a4b1d0684527ea446e765e8a96cf	2024-02-06T04:20:59-05:00	Justin Parker		server : include total "num_slots" in props endpoint (#5349)
31e790322133a4b1d0684527ea446e765e8a96cf	4ffc7a17d4e80c5f3f905139cb570ed9b6934fcb	2024-02-06T04:20:00-05:00	Michael Coppola		server : add `dynatemp_range` and `dynatemp_exponent` (#5352)
4ffc7a17d4e80c5f3f905139cb570ed9b6934fcb	906cff55c2848fda091d888a1585915ec0c9ea9e	2024-02-06T08:16:23Z	Niall Coates		server : various fixes for the prompt field in /completion (#5300)
a2d60c9158435ae9a6f14632f07f1acf7a3becef	e6f81775323f6f4e4a30abf022a6028fa86b79ac	2024-02-05T08:10:22Z	Alexey Parfenov		server : allow to get default generation settings for completion (#5307)
4be04c8965578edc09194fab769b4b922b8444f5	5d55b0cd827bb0fcfedfa329a82bd5d6ef2c93ca	2024-02-05T10:43:57+03:00	Нияз Гарифзянов		scripts : add non-interactive server-llm.sh (#5303)
e437b37fd0b2b97e6c6ff1045ec7f901faa6498a	2d40085c26794e29c434480b9e06738e89e5686f	2024-02-02T14:23:40+02:00	Georgi Gerganov		scripts : parse wtype in server-llm.sh (#5167)
6b91b1e0a92ac2e4e269eec6361ca53a61ced6c6	e805f0fa9951081ce0a86378a7aa52b6f636b82d	2024-02-02T08:56:31+01:00	Xuan Son Nguyen		docker : add build for SYCL, Vulkan + update readme (#5228)
5cb04dbc16d1da38c8fdcc0111b40e67d00dd1c3	efb7bdbbd061d087c788598b97992c653f992ddd	2024-01-31T17:30:17+02:00	Georgi Gerganov		llama : remove LLAMA_MAX_DEVICES and LLAMA_SUPPORTS_GPU_OFFLOAD (#5240)
e0085fdf7c758f0bc2746fc106fb29dd9df959de	e6f291d15844398f8326940fe5ad7f2e02b5aa56	2024-01-30T21:19:26+02:00	Georgi Gerganov		Revert "server : change deps.sh xxd files to string literals (#5221)"
e6f291d15844398f8326940fe5ad7f2e02b5aa56	4003be0e5feef320f3707786f22722b73cff9356	2024-01-30T20:17:30+02:00	Georgi Gerganov		server : fix context shift (#5195)
4003be0e5feef320f3707786f22722b73cff9356	fea4fd4ba7f6b754ac795387b275e1a014a77bde	2024-01-30T12:15:05-06:00	JohnnyB		server : change deps.sh xxd files to string literals (#5221)
813416991ab0d1caa0d12f93ac4e8a24a2add0a3	5589921ef84a4fb1c6d1c9c34d626a5a83033db6	2024-01-30T10:18:02+01:00	divinity76		main : allow empty --prompt-cache file (#5176)
6685cc41c237544623b4b5651eceb9c4280728cc	ceebbb5b21b971941b2533210b74bf359981006c	2024-01-30T17:11:46+08:00	Wu Jian Ping		server : improve README (#5209)
c82d18e863fcde91b4b1109b1d0c73ea4470c405	14fef85e2d5361e6b4dd7a9ecf22bb817362997d	2024-01-29T21:48:10+08:00	Wu Jian Ping		server : embeddings compatibility for OpenAI (#5190)
2307523d322af762ae06648b29ec5a9eb1c73032	0f648573dde61c510560f68244f70ece7e60d8c1	2024-01-28T18:03:59+01:00	0cc4m		ggml : add Vulkan backend (#2059)
39baaf55a160909bb9428bd981014218761a20cb	6db2b41a76ee78d5efdd5c3cddd5d7ad3f646855	2024-01-28T01:55:31-06:00	Kyle Mistele		docker : add server-first container images (#5157)
ec903c034131848da9222536ff18da07ec0882a0	a1d6df129bcd3d42cda38c09217d8d4ec4ea3bdd	2024-01-27T14:38:05+01:00	Maximilian Winter		server : add self-extend support (#5104)
48c857aa10aea73210a4a72da3f1a6f99269e75d	413e7b0559f922bd4de5e9eec548829d111651b1	2024-01-26T13:42:20+01:00	Xuan Son Nguyen		server : refactored the task processing logic (#5065)
2bed4aa3f37cb4e39e16e9ec7b595a7738fd5faf	125d03a5036a02a983c8e98c2cdc126e061afb8e	2024-01-23T08:11:39+01:00	Xuan Son Nguyen		devops : add intel oneapi dockerfile (#5068)
125d03a5036a02a983c8e98c2cdc126e061afb8e	011e8ec577fd135cbc02993d3ea9840c516d6a1c	2024-01-23T01:51:27-05:00	Michael Coppola		llama.vim : added api key support (#5090)
780e24a22eb595b705cbe8284771e9ceff1c4dd2	3ce7e8f8e7ccfce07e5947ac5f1f3f4628cf68ea	2024-01-22T21:15:08+08:00	Reinforce-II		ggml : parallelize FP32 conversion when using BLAS (#5045)
7dcbe39d36b76389f6c5cd3b151928472b7e22ff	726c0fa9a2da976e9c5d5c51e185d9dd453fc9e5	2024-01-21T14:42:44+02:00	Kawrakow		Add ability to evauate multiple choice tasks  (#5047)
7051aacfac0057fa5fac9ea46c55bffc3892d810	2b3b999cacc7ad1207c32fbdf3479a19c06e1a34	2024-01-19T11:39:11+02:00	Kawrakow		winogrande: evaluate log-probs in parallel (#5036)
821f0a271e7c9ee737945245dd7abfa22cc9b5b0	96d7f56d2918ffde1995dbb32392571deb76d7fc	2024-01-18T21:33:05+01:00	Xuan Son Nguyen		server : defer tasks when "slot unavailable" (#5018)
3e945cc1e9c06d2001031360e4e303e9548fb02c	ad19812cda4062c9f154ef16315df41fbe6a770a	2024-01-18T19:18:21+02:00	Kawrakow		HellaSwag: speed up by parallelizing log-prob evaluation (#5020)
ad19812cda4062c9f154ef16315df41fbe6a770a	682986a08eb5cb04865d2e713449f17304d266d8	2024-01-18T15:33:01+02:00	Georgi Gerganov		perplexity : faster HellaSwag via batching (#5017)
4feb4b33eeb1756e46084a4db9230b279af1a480	959ef0c0df725c013c7f712eaa7790b8e38a8e20	2024-01-16T18:41:42+01:00	Maximilian Winter		examples : add complete parallel function calling example (#4974)
4be5ef556de830c5c4f6e45c05ef4427823fe607	0ea069b87bd296c556824e57455433b6c0357340	2024-01-13T20:45:45+02:00	Georgi Gerganov		metal : remove old API (#4919)
0ea069b87bd296c556824e57455433b6c0357340	f172de03f11465dc6c5a0fc3a22f8ec254c6832c	2024-01-13T19:31:26+02:00	Georgi Gerganov		server : fix prompt caching with system prompt (#4914)
356327feb3f66980ab687040495d722696d98970	ee8243adaa9a9f51ff449213383874e49efe368f	2024-01-13T09:20:46-05:00	Ziad Ben Hadj-Alouane		server : fix deadlock that occurs in multi-prompt scenarios (#4905)
ee8243adaa9a9f51ff449213383874e49efe368f	15ebe59210e7fd9817ff67f51fa1a5ee2d004294	2024-01-13T14:16:11Z	makomk		server : fix crash with multimodal models without BOS token (#4904)
e7e4df031b9e29d4b55a4e0b0295187f6b213db1	584d674be622fbf1578694ada6e62eebedbfd377	2024-01-12T20:07:38+01:00	slaren		llama : ggml-backend integration (#4766)
1d118386fea031f01550f8cd47a5c86296e5333f	7edefbd79cc6dea96640edc54c6b94b2b2496d8b	2024-01-11T23:23:49+02:00	Georgi Gerganov		server : fix infill when prompt is empty (#4833)
4330bd83feb39683de4bd7a34cfcf672ff8ac3e4	27379455c38cb13f24de92dbd6fcdd04eeb1b9d9	2024-01-11T19:02:48+01:00	Laura		server : implement credentialed CORS (#4514)
27379455c38cb13f24de92dbd6fcdd04eeb1b9d9	eab67950068e4b125007d027232c47d2a5831cd0	2024-01-11T12:51:17-05:00	Michael Coppola		server : support for multiple api keys (#4864)
eab67950068e4b125007d027232c47d2a5831cd0	d8d90aa343c22fe01429d3540e47ded87e9dcb9d	2024-01-11T12:41:39-05:00	Behnam M		server : add `LOG_INFO` when model is successfully loaded (#4881)
43f76bf1c362c067fce46bb8dcda0b64af8a9533	2f043328e3116724d15b915b5c6078e2df860a69	2024-01-11T16:14:52Z	pudepiedj		main : print total token count and tokens consumed so far (#4874)
2f043328e3116724d15b915b5c6078e2df860a69	2a7c94db5fb67b2f8882d2d16a11bf5d8d12d397	2024-01-11T09:33:26-05:00	Isaac McFadyen		server : fix typo in model name (#4876)
7a9f75c38b5e62fe27b8a5a3ed823b4a3714024b	5c1980d8d4c4e0c0af77359f81cc44d90b3f250b	2024-01-11T02:12:05-05:00	Behnam M		server : update readme to document the new `/health` endpoint (#4866)
5c1980d8d4c4e0c0af77359f81cc44d90b3f250b	cd108e641dbdedd8c5641c4cec1762f751f38136	2024-01-11T09:10:34+02:00	Georgi Gerganov		server : fix build + rename enums (#4870)
cd108e641dbdedd8c5641c4cec1762f751f38136	57d016ba2d46a6e22517a31a75cebb48f9e234b6	2024-01-10T14:56:05-05:00	Behnam M		server : add a `/health` endpoint (#4860)
128de3585b0f58b1e562733448fc00109f23a95d	8c5833031857c9e9ada61948bae894ab9c785f86	2024-01-09T05:02:05-05:00	Behnam M		server : update readme about token probs (#4777)
8c5833031857c9e9ada61948bae894ab9c785f86	18c2e1752c3b387689e9e73d7d8a1a3b1511ce23	2024-01-09T10:12:43+01:00	Zsapi		server : add api-key flag to documentation (#4832)
67984921a70a7e680a24494aeb7575a66e90685d	c75ca5d96f902564cbbbdd7f5cade80d53c288bb	2024-01-07T08:45:26+02:00	Georgi Gerganov		server : fix n_predict check (#4798)
012cf349aec8ffb47c9def5dc018240fa3721e8b	a91928014fcf51fe297823fcff0788de4f14206e	2024-01-04T19:56:33+02:00	Georgi Gerganov		server : send token probs for "stream == false" (#4714)
e5804313a1edaf00726ed0b96ecced07accbf50c	dc891b7f7a23158d54f9383790b92c79cc5906c1	2024-01-04T03:17:09-05:00	Michael Coppola		server : fix options in README.md (#4765)
f2eb19bd8bc9f5730d6e05d7a52a9e19bf5ac099	f3f62f0d835d559e80714bbeb05d03125574e3dd	2024-01-03T03:43:19-05:00	Justin Parker		server : throw an error when `slot unavailable` (#4741)
f3f62f0d835d559e80714bbeb05d03125574e3dd	0ef3ca2ac62016c0c545de1c89dc2e3e130f4a99	2024-01-02T21:07:47+02:00	Georgi Gerganov		metal : optimize ggml_mul_mat_id (faster Mixtral PP) (#4725)
0ef3ca2ac62016c0c545de1c89dc2e3e130f4a99	540938f8904707dd74cb3be18495f853b312e72f	2024-01-02T15:48:49Z	Phil H		server : add token counts to html footer (#4738)
0040d42eeb237197054cc7790df5776eacfa608e	83e633c27efdf0eb0ba54249e784b0ea760b1007	2024-01-02T06:15:16-08:00	Marcus Dunn		llama : replace all API facing `int`'s with `int32_t` (#4577)
5d7002d4372ebf107cfaf46fcd90df27b204f330	26f3071d714f0b27ad7f021a46a66a1085480258	2024-01-02T04:38:15-06:00	minarchist		server : add --override-kv parameter (#4710)
58ba655af054715c0516ee270ad028ad9e74f357	edd1ab7bc34c10a780ee7f9a4499f7689cdad36d	2024-01-02T10:57:44+02:00	Georgi Gerganov		metal : enable shader debugging (cmake option) (#4705)
9fbda719de18a9400a064c28759c39d55d687d3e	39d8bc71edcb8b6f99d46fa4216af7a15232e218	2023-12-30T23:24:42+02:00	Georgi Gerganov		clip : refactor + bug fixes (#4696)
24a447e20af425fa44cf10feaa632b6bb596c80f	a20f3c7465d6d1b33767757c2760643b799a81bf	2023-12-30T15:07:48+07:00	automaticcat		ggml : add ggml_cpu_has_avx_vnni() (#4589)
db49ff8ed7f0bb201176703441cc02911b08ef2a	60f55e888c29cbd87c4238dd19e85d0eef87245d	2023-12-29T06:24:12-08:00	Justine Tunney		server : replace sleep with condition variables (#4673)
60f55e888c29cbd87c4238dd19e85d0eef87245d	b93edd22f55d3e5268263c3edcdae1818505c078	2023-12-29T22:22:44+08:00	SakuraUmi		server : fix OpenAI server sampling w.r.t. penalty. (#4675)
b93edd22f55d3e5268263c3edcdae1818505c078	82d6eab224862a7044069fb9211dc4b29124264b	2023-12-29T06:22:10-08:00	Karthik Sethuraman		server : allow to generate multimodal embeddings (#4681)
441f51dca004debf8b275f1bdc08e0f1af7fd8f8	38b3de4658292582a8941a2be5c77b40ce6ac0f2	2023-12-29T19:23:27+09:00	Tamotsu Takahashi		ci : build with CLBlast + ggml-opencl use GGML_API (whisper/1576)
65e5f6dadbba4b496bba27f573e473c66b446496	ea5497df5d138c83b2b0ca70aefdc4b1175c1001	2023-12-28T11:20:00-08:00	Justine Tunney		Fix OpenAI server sampling w.r.t. temp and seed (#4668)
6123979952385847d8348e295d77d6e01da8aa84	b9ec82d262cb20d7f0a8a1157bfa9aace40e2625	2023-12-23T09:31:49Z	Alexey Parfenov		server : allow to specify custom prompt for penalty calculation (#3727)
31f27758faf4a4bd08101a57c7ec3a473f771f86	56fa50819f7a3ca2128f63b81c17c08a4454479e	2023-12-21T11:57:48-08:00	Marcus Dunn		llama : allow getting n_batch from llama_context in c api (#4540)
2994f0c5a2e8c96955b422dedc93ec2595d16b82	b1306c439490c7fa4ec33594500d980d1e9e15e6	2023-12-17T19:39:02-05:00	Jared Van Bortel		decode : fix logits_valid for legacy API (#4516)
0ffc92d2d23a789625f018840469af045be1e3c0	8edd2b40fdbcafbf630f2cf29306b29d5cb48c42	2023-12-17T17:02:16+02:00	olexiyb		server : disable llm logs if SERVER_VERBOSE is off (#3792)
8edd2b40fdbcafbf630f2cf29306b29d5cb48c42	eb16dae7e70ca97396190698b29c0f9ee3388e88	2023-12-17T15:57:56+01:00	AdithyanI		server : fix grammar being ignored (#4494)
eb16dae7e70ca97396190698b29c0f9ee3388e88	62bd52b7bf90819e75f427a95a484cd5eee0b3c7	2023-12-17T14:56:09Z	Alexey Parfenov		server : fix possible ambiguity in content type charset (#4501)
62bd52b7bf90819e75f427a95a484cd5eee0b3c7	5daa5f54fdcd2b5228add1a4c43a1897b2168f35	2023-12-17T15:54:37+01:00	mzcu		server : allow requests larger than 8K (#4500)
88ae8952b65cbf32eb1f5703681ea592e510e570	ee4725a686643669a8587142fa068cbf29de3ce2	2023-12-15T13:49:01+02:00	ShadovvBeast		server : add optional API Key Authentication example (#4441)
948ff137ec37f1ec74c02905917fa0afc9b97514	4d98d9a65665eee3838cef936641f640e3f5b649	2023-12-13T23:57:15+04:00	shibe2		server : fix handling of characters that span multiple tokens when streaming (#4446)
fecac45658a99eddc4d6e36ba0310ca8f87a77f0	9494d7c4774ab745490b5a19570ff7747a194143	2023-12-12T04:12:35-06:00	kalomaze		server : tweak default sampling parameters (#4367)
d9d4cfef64ea416dd66632173787d03ffb180cc7	41a11aaf99feff4901e4c8dc48ad00766c5da4e9	2023-12-12T11:25:29+02:00	Vladimir Zorin		server : fix local model name in server (#4420)
bcc0eb4591bec5ec02fad3f2bdcb1b265052ea56	81bc9214a389362010f7a57f4cbc30e5f83a2d28	2023-12-07T13:03:17+02:00	Georgi Gerganov		llama : per-layer KV cache + quantum K cache (#4309)
05cd6e5036d72d0930de4d8f6be7bce09e8dda24	caa9249217c5fd524b900add5ddcbeaa20cbcb12	2023-12-06T20:21:59+02:00	Georgi Gerganov		server : recognize cache_prompt parameter in OAI API (#4347)
23b5e12eb5a76489b4c3ee22213a081da68b1809	d208995c6da66f252d4054c1c5a90eb8ccb7a2f7	2023-12-04T17:04:21+01:00	Daniel Bevenius		simple : update error message for KV cache check (#4324)
33e171d1e9fc4903f9314b490d77fb8d58331b63	6949b50df56ee58a2d76d45487942cb211c08629	2023-12-03T01:10:43-08:00	Ed Lee		server : fix OpenAI API `stop` field to be optional (#4299)
6949b50df56ee58a2d76d45487942cb211c08629	d7b800b8bc490a221acbd83c575206a907f2f6e2	2023-12-03T10:03:25+01:00	Rickard Edén		py : add grammar to oai like api (#4294)
1d144112c0fbbb4ecc07dbcf4f05a380148bd6de	f43f09366dfd018e4568e23a232aaa8c4f7cfc78	2023-11-30T17:25:49-05:00	Ziad Ben Hadj-Alouane		server : add --log-disable to disable logging to file (#4260)
f43f09366dfd018e4568e23a232aaa8c4f7cfc78	d2809a3ba2780e00fce5a6149a7eda09f1c0e906	2023-11-30T17:25:04-05:00	Ziad Ben Hadj-Alouane		server : add single-client multi-prompt support (#4232)
e2bd725f4b39bc5c6234858d158e01248f5ab5bd	1f5cd83275fabb43f2ae92c30033b384a3eb37b4	2023-11-30T20:50:40Z	rhjdvsgsgks		py : fix oai proxy (#3972)
af19d3573481d409b3c4e55494810eb1f65a9aae	e9c13ff78114af6fc6a4f27cc8dcdda0f3d389fb	2023-11-25T11:29:06+02:00	Georgi Gerganov		server : OAI API compatibility (#4198)
6b0a7420d03b9d13cb0e9439a01ce8476d8bf093	d103d935c0e75769a6a597f7a64cab72c6cc3e79	2023-11-23T19:07:56+02:00	Georgi Gerganov		llama : KV cache view API + better KV cache management (#4170)
9d5949f04b1f8b76184818abbd99938c2020803f	ff8238f71d56245f4a6dbea693f4ebd81263464d	2023-11-23T12:34:20+01:00	Daniel Bevenius		examples : fix typo in parallel example doc comment (#4181)
936c79b2275a8f15f3512e63de615c676904d650	262005ad9ded375e9c544a02c18ef6254fe185a2	2023-11-19T11:54:10-05:00	SoftwareRenderer		server : relay error messages (#4131)
9e87ef60e18d69338c5efea314aa7e718bf2040a	c7cce1246e248124117ae5bc058923e3ade95f11	2023-11-17T16:24:07+01:00	Jannis Schönleber		common : improve yaml log escaping (#4080)
4760e7cc0b68570d58f55e8dda469805d1759d0d	bb50a792ec2a49944470c82694fa364345e95170	2023-11-13T14:16:23+02:00	Georgi Gerganov		sync : ggml (backend v2) (#3912)
532dd74e38c29e16ea1cfc4e7eedb4f2fab3f3cd	e86fc56f7521ca4b18d1d9939e82abd40c2f1c01	2023-11-11T22:04:58-08:00	Richard Kiss		Fix some documentation typos/grammar mistakes (#4032)
d96ca7ded77df764db797b68b4a29e34c5b56285	34b0a082074b073eb14c2bd93c0c070e20ddcd16	2023-11-11T05:48:21Z	Alexey Parfenov		server : fix crash when prompt exceeds context size (#3996)
4a4fd3eefad5bd17ab6bcd8e2181b4f62eae76cf	df9d1293defe783f42bc83af732d3c670552c541	2023-11-11T06:49:33+08:00	Jhen-Jie Hong		server : allow continue edit on completion mode (#3950)
57ad015dc3011b046ed5a23186c86ea55f987c54	875fb42871a0f5a88fbe31a0b5edd697b84038e4	2023-11-09T04:00:34+02:00	Mihai		server : add min_p param (#3877)
381efbf480959bb6d1e247a8b0c2328f22e350f8	2833a6f63c1b87c7f4ac574bcf7a15a2f3bf3ede	2023-11-06T22:36:23+01:00	Damian Stewart		llava : expose as a shared library for downstream projects (#3613)
bb60fd0bf6bb270744d86dd45b3a95af01b7de45	132d25b8a62ea084447e0014a0112c1b371fb3f8	2023-11-05T23:15:27+07:00	Thái Hoàng Tâm		server : fix typo for --alias shortcut from -m to -a (#3958)
50337961a678fce4081554b24e56e86b67660163	0e40806c1cb3bdf9955ed807ffbe212be85b4c67	2023-11-01T20:11:02+02:00	Georgi Gerganov		llm : add llm_build_context (#3881)
f0e209324a7f663225791897877bf610f1af152d	ca190bca8e844d171020d6147687e71472d71734	2023-11-01T11:29:07+02:00	Georgi Gerganov		scripts : add server-llm.sh (#3868)
ca190bca8e844d171020d6147687e71472d71734	71e3718abdb2771b50c9606d3a7569623a0b0afe	2023-11-01T09:28:28Z	Adrian Hesketh		server : re-enable completion and embedded at the same time (#3876)
82a6646e0221216c41edcdf99f5a44bb051391f5	ba231e8a6dd8ad82acfe0e4d492ff7cef6b3f0a1	2023-10-28T15:43:01+03:00	Aarni Koskela		metal : try cwd for ggml-metal.metal if bundle lookup fails (#3793)
34b2a5e1ee4fe6295fb4420eb91131d743694c65	6961c4bd0b5176e10ab03b35394f1e9eab761792	2023-10-26T22:53:37+03:00	Georgi Gerganov		server : do not release slot on image input (#3798)
ad939626577cd25b462e8026cc543efb71528472	1717521cdb976a2219888b0e5cba36e210eee9df	2023-10-24T16:10:43-04:00	cebtenzzre		server : add parameter -tb N, --threads-batch N (#3584) (#3768)
1717521cdb976a2219888b0e5cba36e210eee9df	b2f7e04bd312eaf97eee0523aa09d950d585626b	2023-10-24T23:08:20+03:00	Georgi Gerganov		server : do not block system prompt update (#3767)
5be6c803fa5378f62a1590f3ad8c6b64c7c0c2ce	6336701c9378c23c85d1c0e464b663ca2bbb8e60	2023-10-23T12:40:03-07:00	Marcus Dunn		llama : remove token functions with `context` args in favor of `model` (#3720)
438c2ca83045a00ef244093d27e9ed41a8cb4ea9	9e70cc03229df19ca2d28ce23cc817198f897278	2023-10-22T22:53:08+03:00	Georgi Gerganov		server : parallel decoding and multimodal (#3677)
d3956aea53369455008159cc405ed4c496976692	22c69a27945e7acf9690dd3210d316f22182751c	2023-10-22T20:09:51+02:00	vvhg1		main : escape prompt for cfg_negative_prompt and consecutive inputs in main with interactive (#3623)
d1031cf49c3b958b915fd558e23453471c29ac33	8cf19d60dc93809db8e51fedc811595eed9134c5	2023-10-20T21:07:23+03:00	Georgi Gerganov		sampling : refactor init to use llama_sampling_params (#3696)
a0edf73bda31c7c4e649e6f07c6fd30a729929cd	f439e506e8ae8b01df2ae2156380f8156d7553e3	2023-10-20T13:06:10+03:00	Georgi Gerganov		server : fix uninitialized sampling context (close #3685)
0e89203b517c95ec6675eda75d200a60d1e8921d	c67fe68e417f766970fb1feaf2e66458aa24116a	2023-10-18T16:21:57+03:00	Georgi Gerganov		speculative : add tree-based sampling example (#3624)
3ad1e3f1a10c1f66b4f1cd7510e0977fadbc0dfd	1142013da40e98946a109b141dd858f0ed996051	2023-10-17T18:51:02+02:00	coezbek		server : documentation of JSON return value of /completion endpoint (#3632)
b016596d903641f8825cd94bb6742e1de0c21017	6b3ae4da92485f979a0f45774fcf68597634db0b	2023-10-12T15:51:53+09:00	Aarni Koskela		server : add completion mode (no chat) (#3582)
57dd55e2c742bfc50e0f5c6fb95c14118cff44f6	b8fe4b5cc9cb237ca98e5bc51b5d189e3c446d13	2023-10-12T09:29:04+03:00	Georgi Gerganov		server : fix kv cache management (#3588)
a8bdd65525ae86dea905e9866ad369b53e30ac14	70c29da118cdb02bfcbd0376c32b5b2236e48e48	2023-10-11T15:42:22-04:00	Michael Coppola		server : add parameter -tb N, --threads-batch N (#3584)
11ea5c7d96f2c28e1c99659e08ec0a44574056e2	95bd60a0a69f57e9a2ff1269667ea484a1a9bb40	2023-10-10T09:31:21+02:00	vvhg1		infill. : fix tokenization (#3508)
8e6716a102e390e930594d51302730184dac83cc	9c38d181d40b9d27f8f42152c18e7c70bfffcf37	2023-10-08T03:55:58-07:00	Ryder Wishart		api_like_OAI.py : compat with Microsoft Guidance (#2746)
9c38d181d40b9d27f8f42152c18e7c70bfffcf37	a1202a31ed8c35705bd09fe91c3e7410c619bd70	2023-10-08T06:52:57-04:00	arcrank		api_like_OAI.py : simplify function (#2796)
cb13d73a720c42d1958bff79b6869d77b26b8cea	9ca79d5cbbc8d43f2bff951404b6a40ff1ee3788	2023-10-06T21:39:33+03:00	Mihai		server : docs fix default values and add n_probs (#3506)
9ca79d5cbbc8d43f2bff951404b6a40ff1ee3788	0c731ca4039ccff86ffab90eaae4ca98037c4496	2023-10-06T10:10:13-06:00	Kerfuffle		kv cache slot search improvements (#3493)
a8777ad84e00cda0399e827cdf971e2c3fab1da2	97af49fa395df77e4c18af0e1655b2fee67c9686	2023-10-06T14:16:38+01:00	pudepiedj		parallel : add option to load external prompt file (#3416)
97af49fa395df77e4c18af0e1655b2fee67c9686	16820a5a0d885113f21021ce934f0b0027b9d69a	2023-10-06T07:44:24-05:00	Jhen-Jie Hong		server : reuse llama_sample_token common util (#3494)
e8b8d32e8663ffc55a02c9721af3a5190382cbb0	8f3a642ec1d878b2d0a0d15e3a4277f522790d4c	2023-10-05T09:02:55-05:00	Jhen-Jie Hong		server : fix incorrect num_tokens_predicted (#3480)
ac2219fef34eb5b713c286c34c6e4162c39c8f3b	48be797ffbd80b062f55778e09e97180eb25d2ab	2023-10-03T21:04:01+03:00	Georgi Gerganov		llama : fix session saving/loading (#3400)
48be797ffbd80b062f55778e09e97180eb25d2ab	f56e1baec361b5381e32ee6b6e56e4f00e002dfe	2023-10-03T10:09:28-07:00	Alex Klinkhamer		llama : expose model's rope_freq_scale in the API (#3418)
c97f01c362ac102c6994edb80008f8608539553a	f5ef5cfb18148131fcf45bdd2331f0db5ab7c3d0	2023-10-02T09:42:02+02:00	vvhg1		infill : add new example + extend server API (#3296)
7f1a0fe709ea1a861da2f3759f58a28bf8953c12	16bc66d9479edd5ee12ec734973554d4493c5dfa	2023-09-29T03:51:52+08:00	Qu Zongfu		ggml : release the requested thread pool resource (#3292)
0e76a8992c8200237bbc6471a53fb8796b3872f7	2db94d98eda56982d80238840b0652b4137a2a84	2023-09-28T20:40:11+02:00	xaedes		train : finetune LORA (#2632)
ec893798b7a2a803466cc8f063051499ec3d96f7	45855b3f1c7bdd0320aa632334d0b3e8965c26c4	2023-09-28T19:04:36+03:00	Georgi Gerganov		llama : custom attention mask + parallel decoding + no context swaps (#3228)
dc6897404e141c74cbbf8030ecfebd74e1815411	527e57cfd8a9a26bf622c0510c21c2508a24be26	2023-09-27T17:48:33+02:00	Rickard Hallerbäck		metal : reusing llama.cpp logging (#3152)
be8c9c245bd129ebabb80e0a7a8dd7daeb4d30af	be6beeb8d75294552c4918fce06d7b84eebf3d79	2023-09-07T15:45:01+02:00	Kawrakow		metal : parallel RoPE on Metal (#3024)
e4386f417faf894f6706eec005e24d142b577fcb	35195689cd835464779c247b1c22ab9247418fd1	2023-09-04T10:28:55+02:00	Aarni Koskela		server : add a subtle loading animation to the edit box (#2466)
571083f508266c4eb5cb5457d836df5dd3c173ce	f04d0028444bc9b3d4225fba47e19d4c3aeb3741	2023-09-02T08:31:46+08:00	Jhen-Jie Hong		server : avoid aniprompt in probabilities of final response (#2849)
44c117f41ee01c5ac8fb86bba041f08d8b87b46d	43033b7bb4858da4f591715b3babdf906c9b7cbc	2023-08-28T21:51:47+02:00	xaedes		train : mem usage and other improvements  (#2439)
c1ac54b77aaba10d029084d152be786102010eb2	730d9c681e339b76407659344e5a2cd50af7d7d5	2023-08-26T16:11:45-07:00	Bruce MacDonald		server : add `/detokenize` endpoint (#2802)
730d9c681e339b76407659344e5a2cd50af7d7d5	c7d92e6dfec3f54849f3a0ba373054d29f321ea2	2023-08-26T14:13:36-06:00	Kerfuffle		convert.py : advanced option (#2753)
2ba83c8685177faea3399db9564f9c52df75c366	bae5c5f679e043371bc2b4dffff8d4964d6cb953	2023-08-26T13:45:53+02:00	klosax		Fix spm whitespaces (#2806)
bae5c5f679e043371bc2b4dffff8d4964d6cb953	232caf3c1581a6cb023571780ff41dc2d66d1ca0	2023-08-26T10:07:43+02:00	lon		examples : skip unnecessary external lib in server README.md how-to (#2804)
29674ab4e847fcaba60cc6558f0d46d5f74ae279	5439a0ab57c16b556ffa91a0953df5e46b1e7fb4	2023-08-25T18:32:45+08:00	Jhen-Jie Hong		server : display token probabilities in the UI (#2489)
cf658adc832badaaa2ca119fe86070e5a830f8f6	a192860cfec89a38d59a943623bf595b1fe4495b	2023-08-23T23:08:04+03:00	Georgi Gerganov		llm : add Falcon support (#2717)
b8ad1b66b23f9b2e6e4531e9a62753323036a556	f5fe98d11bdf9e7797bcfb05c0c3601ffc4b9d26	2023-08-23T02:12:12-05:00	Xiao-Yong Jin		server : allow json array in prompt or content for direct token input (#2306)
46ef5b5fcf4c366e1fb27726b6394adbbf8fd0ea	c63bb1d16a70c03440671b76954bb767513cead8	2023-08-22T23:10:42+02:00	goerch		llama : fix whitespace escaping in tokenizer (#2724)
226255b44ef2c2794bfac48d101d35a9c2dbb965	930523c8e1cbbee5449c055daa894917fac6805e	2023-08-22T08:32:00+08:00	Jhen-Jie Hong		server : fallback to default if client param is null (#2688)
6381d4e110bd0ec02843a60bbeb8b6fc37a9ace9	dadbed99e65252d79f81101a392d0d6497b86caa	2023-08-21T23:07:43+03:00	Georgi Gerganov		gguf : new file format with flexible meta data (beta) (#2398)
1f0bccb27929e261744c979bc75114955da49e98	f63564adfaa157ca387071d6b9a06cfaef0ef576	2023-08-19T00:45:36+03:00	Georgi Gerganov		server : better default prompt (#2646)
f63564adfaa157ca387071d6b9a06cfaef0ef576	2d8b76a110d76ff6b5728ff0af8477531e4db60e	2023-08-19T05:41:32+08:00	Jhen-Jie Hong		server : update xxd usage for older versions compatibility (#2649)
10151bee2e38b5711335c4a38f6ca93b50223acf	0992a7b8b18a89e29a205efb48ceb559c9a08203	2023-08-17T23:34:01Z	staviq		server : support for saving templates in browser LocalStorage (#2486)
3ebb00935f3f0522b75df49c2769ab1774b91380	d783f7982e0e823a2626a9956359c0d36c1a7e21	2023-08-15T06:14:14+08:00	Jhen-Jie Hong		server : add missing /json-schema-to-grammar.mjs (#2616)
d75561df207d22790609ee0ad924302f66ac2599	348acf188c9fbe66396990f2dc83229df367969b	2023-08-14T15:36:42+02:00	Cheng Shao		server : add --numa support (#2524)
2feb8934eb75ca63f3c42724229cce1df9579c8e	5517d6e69214cdead000a76983b9fe175c3f8329	2023-08-14T16:20:17+08:00	Jhen-Jie Hong		server : fix default grammar by use empty string in the UI (#2604)
5517d6e69214cdead000a76983b9fe175c3f8329	f31b5397143009d682db90fd2a6cde83f1ef00eb	2023-08-14T15:16:54+08:00	Jhen-Jie Hong		server : implement json-schema-to-grammar.mjs & add grammar param in the UI (#2588)
53dc399472d5bd35ee739b865e843b1996bd3814	9ca4abed893685692f90413e4d43153af12342d9	2023-08-12T06:35:14+08:00	Equim		server: fixed wrong variable name in timing json (#2579)
1638757767072a4957f52b9e3594f0b67610631b	916a9acdd0a411426690400ebe2bb7ce840a6bba	2023-08-10T12:16:38+02:00	Martin Krasser		Fix grammar-based sampling issue in server (#2566)
182af739c4ce237f7579facfe8f94dc53a1f573f	4329d1acb01c353803a54733b8eef9d93d0b84b2	2023-08-04T15:00:57-04:00	Cebtenzzre		server: regenerate completion.js.hpp (#2515)
5f631c26794b6371fcf2660e8d0c53494a5575f7	415e99fec27be5a2e4283f1937afd17eb33fbd66	2023-08-04T06:37:24-05:00	Stephen Nichols		Fixing race condition in server and partial stream handling in frontend. (#2391)
415e99fec27be5a2e4283f1937afd17eb33fbd66	ff966e7ca6af127c9405523cdb07ef8fa01bf6d6	2023-08-04T19:29:52+08:00	l3utterfly		Stream save llama context data to file instead of allocating entire buffer upfront (#2488)
c574bddb368424b5996cbee2ec45ec050967d404	86aeb27734481751592abd85590020b40d9224c8	2023-08-01T20:54:28+08:00	Bono Lv		fix a typo in examples/server/README.md (#2478)
86aeb27734481751592abd85590020b40d9224c8	1873ff586bd8499a18f763632711bf15d253585e	2023-08-01T01:56:23-07:00	ebraminio		server : Support dark mode (#2414)
34ae1caf7fdea4c4c09087002e15e6230102e6a9	d91f3f0c55663719ea03b76311e8c36ed55eb0e2	2023-07-29T03:02:10+09:00	nhamanasu		examples : server chat mode with llama2 (#2400)
d5512b782b27ff698007dcd175da18959d5f163f	c798308e3a425eae050a1f249a576fa8c6433327	2023-07-25T11:36:17+02:00	slaren		server: add rms_norm_eps parameter (#2380)
c798308e3a425eae050a1f249a576fa8c6433327	41c674161fb2459bdf7806d1eebead15bc5d046e	2023-07-25T10:27:34+03:00	Henri Vasserman		[Server] Escape HTML in webchat (#2368)
b3f138d05849ccbce67303ac17b50ebbc268128a	5b2b2dc6ae8086bff7c9b3c17fb435cf319b7185	2023-07-24T17:54:22+03:00	Aarni Koskela		Chat UI extras (#2366)
4f06592cc6b83979e4b442e8cb97b3948c857188	70d26ac3883009946e737525506fa88f52727132	2023-07-23T17:31:17-03:00	IgnacioFDM		Add gqa parameter support to the server (#2351)
355c80f49e32b0b15c0a457f3bad380e57f5b9ac	83a00ce69bef9124c0702424a012ea799128b77d	2023-07-23T06:16:48-05:00	AustinMroz		examples : simplify vim plugin (#2327)
24baa54ac1ff3d4156a2360deb1473af04a9b1a2	dd6c67d3cbb7b360747f776412bf01976aa32f4b	2023-07-22T12:34:51+02:00	whoreson		examples : basic VIM plugin
9cf022a1889e50113fd348dc96b4557fc75a6296	e782c9e735f93ab4767ffc37462c523b73a17ddc	2023-07-21T09:42:21+02:00	Przemysław Pawełczyk		make : fix embdinput library and server examples building on MSYS2 (#2235)
294f424554c1599784ac9962462fc39ace92d8a5	45a1b07e9b20c33d71d8c849ff27d693a75a0269	2023-07-19T15:06:40+08:00	Rinne		llama : extend API to get max devices at runtime (#2253)
6e7cca404748dd4b1a3affd0d1296e37f4ac0a6f	a6803cab946c817fb7aaf2a40b317f5d3e373bd1	2023-07-15T06:34:16-04:00	Xiao-Yong Jin		llama : add custom RoPE (#2054)
3ec7e596b2ba3f43c22f441254ca2bcfa91102ba	917831c63a4138814d23da1917bf2b5d5b9faa6c	2023-07-12T01:12:35+09:00	Jinwoo Jeong		docker : add '--server' option (#2174)
5656d10599bd756dc0f17284e418e704200b43f3	1d1630996920f889cdc08de26cebf2415958540e	2023-07-10T11:49:56-04:00	Evan Miller		mpi : add support for distributed inference via MPI (#2099)
1d656d6360359cfdaaf5d64ed9690047b600dbcb	72421402834141df6cbdcf595fe46dbd11874dce	2023-07-08T00:24:01+08:00	Qingyou Meng		ggml : change ggml_graph_compute() API to not require context (#1999)
31cfbb1013a482e89c72146e2063ac4362becae7	983b555e9ddb36703cee4d22642afe958de093b7	2023-07-05T16:51:13-04:00	Tobias Lütke		Expose generation timings from server & update completions.js (#2116)
983b555e9ddb36703cee4d22642afe958de093b7	ec326d350c72afd23709a409944728a607188cc0	2023-07-05T18:03:19Z	Jesse Jojo Johnson		Update Server Instructions (#2113)
8567c76b5326e862be0755a8dc1dd988223fcae3	924dd22fd3ba93e097f8d19ba5cda919ca2fe2fb	2023-07-05T15:13:35Z	Jesse Jojo Johnson		Update server instructions for web front end (#2103)
f257fd255044decffad93dee2502875ce66ad80c	7ee76e45afae7f9a7a53e93393accfb5b36684e1	2023-07-05T03:06:12+09:00	jwj7140		Add an API example using server.cpp similar to OAI. (#2009)
7ee76e45afae7f9a7a53e93393accfb5b36684e1	acc111caf93fc6681450924df9f99679c384c59e	2023-07-04T10:05:27-04:00	Tobias Lütke		Simple webchat for server (#1998)
acc111caf93fc6681450924df9f99679c384c59e	23c7c6fc9182b041f006b86ea1e7f99911ecf344	2023-07-04T15:38:04+03:00	Henri Vasserman		Allow old Make to build server. (#2098)
1cf14ccef12e19c5a5b0b17ab456242d1f8c7fdd	cc45a7feb8412e84ff292207621412fffc0d3d51	2023-07-04T00:05:23+03:00	Henri Vasserman		fix server crashes (#2076)
d7d2e6a0f0c74f7a570dae384dfff371ac744d2a	46088f72318981341a2d646f12f6eee6aec06d65	2023-07-03T05:38:44+08:00	WangHaoranRobin		server: add option to output probabilities for completion (#1962)
b1ca8f36a9cdbcee5f5c425df717611a1040a897	b8c8dda75fdf5fdea49c80af36818e7c30fe0ddf	2023-07-01T23:42:43+08:00	Qingyou Meng		ggml : disable GGML_TASK_INIT and GGML_TASK_FINALIZE by default (#1995)
b853d456018b10820686362af41b2f2f75f1eec6	9225baef71407d799a6f7f563b77fd7f82791416	2023-06-26T13:57:59-04:00	zrm		ggml : add NUMA support (#1556)
c2a08f87b8d180115d04b8688f383d1b2761b16d	66a2555ba6cab954c56d653b29c27bfbbacfbfb1	2023-06-25T08:48:36Z	anon998		fix server sampling: top k sampler first (#1977)
527b6fba1d237befb324fd846bda7418c0fa394d	d7b7484f74d486f77feb4c0b7af7e1718ed91651	2023-06-24T11:47:58+03:00	Didzis Gosko		llama : make model stateless and context stateful (llama_state) (#1797)
20568fe60f00155fa25e92eb3a7f6b911d557967	18b35625c3c19c64b7818a12460ba5ddb006dfdc	2023-06-20T01:12:39+03:00	Henri Vasserman		[Fix] Reenable server embedding endpoint (#1937)
fc45a81bc642b9ef33d9004f2b363d558438a6c9	794db3e7b982fee37e3995db9c3a216a57ff65e3	2023-06-17T17:13:05+05:00	Faez Shakil		exposed modules so that they can be invoked by nix run github:ggerganov/llama.cpp#server etc (#1863)
794db3e7b982fee37e3995db9c3a216a57ff65e3	5ddf7ea1fb42bac21026de2f77e0f9c069b92234	2023-06-17T07:53:04-04:00	Randall Fitzgerald		Server Example Refactor and Improvements (#1570)
9dda13e5e1f70bdfc25fbc0f0378f27c8b67e983	37e257c48e350cf03c353c10d31e777f8d00123d	2023-06-15T18:36:38+01:00	Srinivas Billa		readme : server compile flag (#1874)
4bfcc855abdb2c9fcc3c5a84747974521909fa41	6b8312e7979b852f6b6ac9d29cd51fda16c17948	2023-06-15T20:29:48+03:00	Georgi Gerganov		metal : parallel command buffer encoding (#1860)
e32089b2c20b1b87b22912f4a8b93fe01647d5b9	2347e45e7bdb09c9a7d74b2c0bc86c2b65f0c343	2023-06-13T21:04:40+02:00	xaedes		train : improved training-from-scratch example (#1652)
17366df842e358768c0df7024484fffecfc7865b	44f906e8537fcec965e312d621c80556d6aa9bec	2023-06-06T21:33:23+02:00	Johannes Gäßler		Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)
7552ac586380f202b75b18aa216ecfefbd438d94	5d1830b99dfd85bb6279adb4dd94aa444afd5b5e	2023-05-29T19:31:44+03:00	Georgi Gerganov		ggml : sync cgraph import / export API
1b78ed20818b72306edc7208b9bfb69a1a0d3297	337aea11390221bc925e4acb1f603f1649af2735	2023-05-28T11:48:57-06:00	Kerfuffle		Only show -ngl option when relevant + other doc/arg handling updates (#1625)
0df7d63e5ba0ab8856476e121a03b985d6f15c9d	97c9b77c4fc5e2283755c4418759cfc5fc73ad05	2023-05-27T11:04:14-06:00	Kerfuffle		Include server in releases + other build system cleanups (#1610)
7e4ea5beff567f53be92f75f9089e6f11fa5dabd	7780e4f479dc5af106287c164b8e186cd9b6215c	2023-05-21T11:51:18-06:00	Steward Garcia		examples : add server example with REST API (#1443)
affc76edfdefa7b326f526e463cc65ff13fcfb92	ea600071cb005267e9e8f2629c1e406dd5fde083	2023-05-20T14:19:28+02:00	Johannes Gäßler		cuda : loading models directly into VRAM, norm calculation on GPU, broadcasting for ggml_mul (#1483)
ec2e10c4443209da56b431b24dd0845b60e757fb	d2c59b8ba498ab01e65203dde6fe95236d20f6e7	2023-05-20T11:06:11+03:00	Georgi Gerganov		llama : add llama_init_backend() API (close #1527)
7694b52b9a206b93d59139c3c7c9b55da0f5aa59	79e3efb0e97b65b6cc72cd9ee970fa8189ad79a4	2023-05-19T10:24:59-07:00	Jason McCartney		main : make reverse prompt option act as a stop token in non-interactive mode (#1032)
5ea43392731040b454c293123839b90e159cbb99	ee9654138ab0ae5f138f4abddf56ca234ea3c352	2023-05-18T19:31:01+02:00	Erik Scholz		make kv_f16 the default for api users (#1517)
f954edda935a70a14cf0cc45ecc7fe7d60cf3e4b	f048af0230ad5381bb20b9e3c1467ec6fc7debdf	2023-05-13T14:56:40+02:00	xaedes		ggml : implement backward pass for llama + small training-llama-from-scratch example (#1360)
dd7eff57d8491792010b1002b8de6a4b54912e5c	7fc50c051ae8a78e9643fdf172d12e20f2dd9b6c	2023-04-29T08:34:41+03:00	Ivan Stepanov		llama : new sampling algorithms (#1126)
c4fe84fb0d28851a5c10e5a633f82ae2ba3b7fae	1d78fecdab4087028a38517e86ed129f077174d8	2023-04-24T07:40:02+03:00	Georgi Gerganov		llama : refactor get / set state + remove redundant kv cache API (#1143)
b6e7f9b09e9c340ec97a2fae61c1eb8db861f2f9	50cb666b8a2e35a49b08c0f6bc81138c8f6f2ac1	2023-04-22T08:21:32+02:00	xaedes		llama : add api for getting/setting the complete state: rng, logits, embedding and kv_cache (#1105)
a32f7acc9f54dba1c728cb1e596bd00bf3b4eb5f	43ffdefb7424f79a3d510c199e2ea86684b4f824	2023-04-14T15:37:11+02:00	Pavol Rusnak		py : cleanup dependencies (#962)
95ea26f6e92d620a5437f576b80868aee7f808d6	82d146df9b43cf677e0dbce20b03cf864958a0cc	2023-04-13T14:46:23+02:00	SebastianApel		benchmark : add tool for timing q4_0 matrix multiplication (#653)
f963b63afa0e057cfb9eba4d88407c6a0850a0d8	aaf3b23debc1fe1a06733c8c6468fb84233cc44f	2023-04-08T12:24:37-07:00	comex		Rewrite loading code to try to satisfy everyone:
e986f94829bae0b9e66b326acbbba179931c84f1	c0bb1d3ce21005ab21d686626ba87261a6e3a660	2023-04-02T12:23:04+02:00	Christian Falch		Added api for getting/setting the kv_cache (#685)
f4f5362edb01b05c383b23f36d7b3489c77061b5	863f65e2e32dc1e6d23c96a4811bf382d6b2a548	2023-03-24T15:23:09Z	Gary Mulder		Update README.md (#444)
56e659a0b271436e24813a801640d015e7b05328	40ea807a972ec7b5a426f034ebfa593b5e7a06ed	2023-03-22T17:09:38+01:00	Erik Scholz		fix perplexity after c-api refactor (#390)
f5a77a629bd0f37ae1696747633ab42a5530ec15	da0e9fe90ccf6e73597eb19dd0cfc0a28363fb3b	2023-03-22T07:32:36+02:00	Georgi Gerganov		Introduce C-style API (#370)
5cb63e2493c49bc2c3b9b355696e8dc26cdd0380	da5303c1ea68aa19db829c634f1e10d08d409680	2023-03-20T08:24:11Z	Stephan Walter		Add tqdm to Python requirements (#293)
7392f1cd2cef4dfed41f4db7c4160ab86c0dfcd9	ad5fd5b60cfdfbfb22b0f2bc9e9f6c9692768f8d	2023-03-19T12:38:44-06:00	Suaj Carrot		Improved quantize script (#222)