68 lines
11 KiB
Plaintext
68 lines
11 KiB
Plaintext
ebce9e1a548c2329aa97f53b8b2ad50d968088dc e850ff4de25ad1221abc9bf3bb30df252ccd9c36 2026-05-27T09:38:00+08:00 Yunzhe Jia origin/runtime_replace Refactor cal-llm integration by removing runtime capacity loading and adjusting request handling
|
|
e850ff4de25ad1221abc9bf3bb30df252ccd9c36 9985688f7fa96f755882f96a2cd8a18114fdc42d 2026-05-26T10:59:45+08:00 Yunzhe Jia Enhance cal-llm integration by adding runtime checks for CALRT_LIBRARY and updating link settings for Linux and Windows
|
|
9985688f7fa96f755882f96a2cd8a18114fdc42d 38ca6895815671a87ceec86b4aa4eb976580ce76 2026-05-25T09:05:49+08:00 Yunzhe Jia Refactor CalrtEngineConfig initialization by removing redundant parameters
|
|
38ca6895815671a87ceec86b4aa4eb976580ce76 ddd60c928224b52eb4e1e60e01e8a1ecbb80ee45 2026-05-20T16:37:13+08:00 Yunzhe Jia Add support for cal-llm profile dumping to JSONL file
|
|
ddd60c928224b52eb4e1e60e01e8a1ecbb80ee45 2716130010c58f1cdd9d94f0e2f8e047bc92dc66 2026-05-20T09:22:40+08:00 Yunzhe Jia Add cal-llm backend profiling support with command-line option
|
|
c931ef3163940227c9b6291e04216245cce21429 a43741244a646d3f8fa3ff01bb9b7d059223d0a5 2026-05-18T17:34:37+08:00 wangbomeng calrt: fix prefill_by_ids.fix create_buf
|
|
2716130010c58f1cdd9d94f0e2f8e047bc92dc66 b35bda124ccd4ed581dd6088d3ffa4931c2809b6 2026-05-18T08:40:54+08:00 Yunzhe Jia fix n_ctx_slot error by adding runtime capacity loading for cal-llm
|
|
a43741244a646d3f8fa3ff01bb9b7d059223d0a5 b2003d6c90ef0fa26ab9e930ba3e22b355eb3d39 2026-05-15T14:39:53+08:00 wangbomeng run llama-passkey successfully, fix llama-bench, copy 3 times input to infer qwen2.5vl
|
|
b35bda124ccd4ed581dd6088d3ffa4931c2809b6 81a2cbd4cef5d28334ff513d6b69e593d9d1cb49 2026-05-15T09:19:31+08:00 Yunzhe Jia Implement vocab-only model initialization and enhance cal-llm backend error handling
|
|
81a2cbd4cef5d28334ff513d6b69e593d9d1cb49 3b14ed556c15529fe1f94b649f49db7156dfaf67 2026-05-14T16:06:37+08:00 Yunzhe Jia Enhance CMake configuration for cal-llm integration by updating paths and adding library properties
|
|
3b14ed556c15529fe1f94b649f49db7156dfaf67 dde8b8228081769c8d8f1e0751d47fa7875f8423 2026-05-14T14:34:25+08:00 Yunzhe Jia - Removed references to CALRT from clip.h, mtmd-helper.cpp, mtmd-helper.h, mtmd.cpp, and mtmd.h. - Updated server.cpp to conditionally include CAL-LLM support. - Introduced option LLAMA_SERVER_USE_CAL_LLM in CMakeLists.txt to enable CAL-LLM integration. - Refactored server context to handle CAL-LLM requests and responses. - Updated image processing logic to remove CALRT-specific implementations. - Ensured compatibility with existing llama functionality while integrating new CAL-LLM features.
|
|
fabcc7dac4b34d83fe430980bb364b81087c7ee9 1e9787962f20a7e82c71589ac1dd0585454e4bfe 2026-04-30T16:17:17+08:00 wangbomeng calrt: fix encode dump
|
|
f584311c716dd078c4b737eebbfda97fe12b7274 a339954cc2a145a80c5ea349e7896211916cbed9 2026-04-30T16:05:15+08:00 wangbomeng calrt: fix encode dump
|
|
1bec0db5a675ddc60fb793be2a746e8f3c8855dc 465df20c3e1f3f58d0f5531c796e0941a49c32b0 2026-04-30T16:02:59+08:00 wangbomeng origin/dev-ben bench: support 2 calbins
|
|
465df20c3e1f3f58d0f5531c796e0941a49c32b0 a339954cc2a145a80c5ea349e7896211916cbed9 2026-04-30T09:08:12+08:00 wangbomeng support one calbin
|
|
431ad6f1c787f1b47e9e7be14b2e1a7d8565485c efa1876bb8b2a449a55054a8c3745892f2c0f262 2026-04-27T16:52:15+08:00 wangbomeng update calrt_infer
|
|
4a2a3181f1cea170105c771e6ba69d851b82b937 e3ea5541259f35871c3e995331770aaca297e9ec 2026-04-26T10:56:02+08:00 wangbomeng add calrt-version
|
|
e3ea5541259f35871c3e995331770aaca297e9ec 0b8e43943846a1cd05c26c9186b9ef778ebae6e2 2026-04-26T10:55:48+08:00 wangbomeng add calrt-version
|
|
5eb46fffbd2e260c540fb112314ad67bbb8f56b6 005112c51e00d998b457337ca3dad53fc46e2d0b 2026-04-24T16:24:51+08:00 wangbomeng clip: add image_to_patches; calrt: vision copy data from bf16 to fp32
|
|
005112c51e00d998b457337ca3dad53fc46e2d0b 509670642e8090a1713f5d73590b549be827aaef 2026-04-24T16:24:31+08:00 wangbomeng clip: add image_to_patches; calrt: vision copy data from bf16 to fp32
|
|
5d219bfcef239c1e3ddd1baecc0514a9462ff6a8 6787a53ab9b4897c5a7b51a4062d7b90e6697d35 2026-04-24T09:31:32+08:00 wangbomeng calrt: recover base = batch_index * dict_len
|
|
6787a53ab9b4897c5a7b51a4062d7b90e6697d35 e1a76abf66178ea85656479a5e19aea7785c09f4 2026-04-24T09:22:02+08:00 wangbomeng calrt:input of multimodel from fp32 to bf16
|
|
e1a76abf66178ea85656479a5e19aea7785c09f4 99dd308adb8488fa869bb669e3335e646a938eff 2026-04-22T16:29:22+08:00 wangbomeng calrt:add CalcoreRT version print
|
|
99962021f2dd1994dbbf90d5712f0ca2633f20f8 9af6682ef101c6d006c743c703cf150ac25f466f 2026-04-17T14:48:33+08:00 wangbomeng origin/dev-ot calrt: add onetoken slice and untile_prefill
|
|
e24f775ee26ea5249d5ff6cd23b8a0a17fe1438d a206460e610aef995e36e50b33e8bd41fe477541 2026-04-15T10:01:09+08:00 wangbomeng calrt: add copy_data_to_ibuf for vision model
|
|
a206460e610aef995e36e50b33e8bd41fe477541 d8b2aaa00049978cebac15041f960d75b552f97b 2026-04-14T10:23:43+08:00 wangbomeng calrt: support mixture of prefill_by_ids and prefill_by_embeds
|
|
0cd44929b442860dc0e5f88976108be82350f9dc b8153b6b8f244b223c9f4c2940ae1f212634519e 2026-04-09T15:08:50+08:00 Bomeng Wang rm calculet0.txt
|
|
9626239f5a9e568c9975d67dd6745fef90279a87 da724f3e2a8af2c2537e3edcff41e9415ac66fef 2026-04-08T17:47:04+08:00 wangbomeng calrt: fix MapBuf
|
|
da724f3e2a8af2c2537e3edcff41e9415ac66fef 18814f9bf1a423ebe8f32d6043c9cbc5b21b0218 2026-04-08T16:58:32+08:00 Bomeng Wang calrt: add MapBuf
|
|
bbee06d6d851e3f84f75b578047967d7e0e4a8dc e126c21ed7b793b648d63533ea7ee30885f5a82a 2026-04-08T11:29:36+08:00 wangbomeng calrt: add test time print
|
|
5603e050af07173589f3b8850121263d86da01fd 1e8a16cd0e3ad3c9a0f8746852a0a38c6e52322e 2026-04-01T05:57:55+08:00 wangbomeng calrt: add t_incopy and t_outcopy
|
|
1e8a16cd0e3ad3c9a0f8746852a0a38c6e52322e 893e52bda0fee99bbda1521ea733a760bc4201f1 2026-04-01T10:14:22+08:00 wangbomeng calrt: fix slice and add infer/copy time
|
|
6d5e83902bdd3142a8ff0d3db19f02a8619e95a0 e4eaab700333490e80ebefc8d023f6c1adfcc312 2026-03-27T00:57:11+08:00 wangbomeng server: printf calrt commit ID
|
|
e4eaab700333490e80ebefc8d023f6c1adfcc312 aeacc23a883400db0ebffb50e23355ada054da66 2026-03-25T09:03:55+08:00 wangbomeng calrt: prefil to prefill
|
|
aeacc23a883400db0ebffb50e23355ada054da66 cbaa7492663630132adeddccd9fec5e44ffa3336 2026-03-25T08:49:22+08:00 wangbomeng calrt: add slice only on decode
|
|
3c08ebf0e442cd730ddffd959ec676f9caf31c82 613bc2b9a9d7af92efbe42d876ffcdb244f7a00e 2026-03-24T02:43:03+08:00 wangbomeng calrt: comment LOG_ERROR in untile_decode_cpy
|
|
613bc2b9a9d7af92efbe42d876ffcdb244f7a00e 4e194ecc6c4b8ebe4c72d93f6055e3605dbfcefa 2026-03-24T02:30:12+08:00 wangbomeng calrt: fix max_seq_len judgment
|
|
4e194ecc6c4b8ebe4c72d93f6055e3605dbfcefa 16cbf81a731f5839a2f6b0eb9d8539826353748b 2026-03-24T01:59:03+08:00 wangbomeng calrt: fix ubatch.embd cpy
|
|
16cbf81a731f5839a2f6b0eb9d8539826353748b 8b4e17d990c23025148c4abadefe1010a0dd0734 2026-03-23T09:38:21+08:00 wangbomeng calrt: fix model_name of untile_cpy
|
|
6dacdd2cf9574214ca272a86674e7bd7ba21c4f0 3e6ad64467771224f072e5bad90e270951ba4cdf 2026-03-23T14:42:28+08:00 wangbomeng calrt: add multimodal
|
|
3e6ad64467771224f072e5bad90e270951ba4cdf b37b7d9756feb3dac2db526eeab38b572a095d47 2026-03-23T14:36:41+08:00 wangbomeng calrt: add multimodal
|
|
d0a1b2c758440720d42fa108b3444f54593daa73 b37b7d9756feb3dac2db526eeab38b572a095d47 2026-03-12T16:10:28+08:00 Bomeng Wang calrt: comment out dump
|
|
7ddafbdcb9426ae3af016925b8b596f11e8742d0 059009eeaf20a569abfbac5eb37dad3bb9376428 2026-03-10T07:13:04+08:00 wangbomeng calrt: commented out cal_ctx->encode(batch)
|
|
059009eeaf20a569abfbac5eb37dad3bb9376428 1b073661d1311b5300173993b9f31ee7241d8606 2026-03-10T07:04:22+08:00 wangbomeng calrt: add multimodel
|
|
6295273c5866b9249bacdedbfc3a31877e6e6a85 c6ea3f0d2468e3b8eab5de80bacee7fe4c9dd3d7 2026-03-10T06:54:41+08:00 wangbomeng arg: update hf_repo url to https://download.calculet.tech:9443
|
|
f8fba66b657c51a1df1efc7267bfea9f6140cebf db4a61d2234c2f457b42ecc3f7219a1e1a35508a 2026-03-06T15:06:36+08:00 Yunzhe Jia fix calrt_install include path
|
|
e672e02ca1a582f9e3a9d011d9e1b4fea4942a25 27b82f64252779ad160a3fa76bd378c39421de36 7a3a9a0e76bb5f530beafcfe52e87e388e93117a 2026-03-06T11:47:09+08:00 Yunzhe Jia Merge branch 'dev' of http://192.168.10.26:1000/yunzhe/llama.cpp into dev
|
|
27b82f64252779ad160a3fa76bd378c39421de36 0bd95719fed2f0247c8d0199dd897d24157dfae6 2026-03-06T11:42:45+08:00 Yunzhe Jia adapt to calrt_objs target
|
|
7a3a9a0e76bb5f530beafcfe52e87e388e93117a 583c387efaf7bc030574e554088de79d09a27fbd 2026-03-05T07:24:59+08:00 wangbomeng calrt_infer: fix past_kv_len
|
|
aa0a17d719326a63e0d6fea60aa0ced44e7abc33 fa332e773da681f3e77d6ffe83a87edb557f758b 2026-02-27T01:40:11+08:00 wangbomeng calrt: add bf16_to_fp32
|
|
49fea70a20f550bfdb59d0ffe041b54919c22447 74a118df31b6a4acc8876b2a2db90d2395cc6ec3 2026-01-28T09:11:16+08:00 Yunzhe Jia adapt to new calbin test_case
|
|
74a118df31b6a4acc8876b2a2db90d2395cc6ec3 98e8f9acfe87cd93646482cb2d942b8a132f0852 2026-01-13T14:32:47+08:00 Yunzhe Jia sync with calrt update
|
|
8c8152a04036bb0d4756a4e08e54f514dae4e64d 5d2387931528fbe04aa8d66de935147efb65ca4d 2025-12-09T14:40:04+08:00 Yunzhe Jia adapt to calrt csr
|
|
e6285a748657add8d974b78ca920c5b41753ee12 6b1ecdbbe3cc72ed8888be38f9e934cfd79b9fbb 2025-11-27T16:58:35+08:00 Yunzhe Jia adapt to calrt
|
|
240d9bb75241c91896afe125f2fc74698a7395f3 7eeb241aad429a68fb8cfa3ba85d000fb2348cd2 2025-11-24T12:03:00+08:00 Yunzhe Jia adapt to calrt modification
|
|
98c8269abefdfa8fde47dfb2769ceebc8b704e86 2790ecc304e384d9075c55d0628d8bf440025dc4 2025-09-30T17:42:57+08:00 Yunzhe Jia server: adapt to calrt
|
|
2790ecc304e384d9075c55d0628d8bf440025dc4 f528e97d894b4d93934a0711a00253eea980e799 2025-09-30T17:37:58+08:00 Yunzhe Jia adapt to calrt
|
|
f528e97d894b4d93934a0711a00253eea980e799 dcbe998a6d8f13b6c9cb36bbe7b355ced2ac3842 2025-09-11T14:13:35+08:00 Yunzhe Jia add calrt mtmd support
|
|
dcbe998a6d8f13b6c9cb36bbe7b355ced2ac3842 87932ec016f0ec81e98a13ce5212851f8c12458a 2025-09-05T14:34:07+08:00 Yunzhe Jia add calrt API used in server side
|
|
3a617cb18121a85eed17ac5585788810c5d9c1e0 c42293848dd9f03eba9a6c1b85a600b398f06541 2025-08-13T10:58:59+08:00 Yunzhe Jia add calrt_decode
|
|
c42293848dd9f03eba9a6c1b85a600b398f06541 1cbf442f50a154aac0bf35d7b8b3436a2cdfd6f5 2025-08-06T15:46:06+08:00 Yunzhe Jia sync with calrt API
|
|
1cbf442f50a154aac0bf35d7b8b3436a2cdfd6f5 ba67d6c03fed3193987a4ef13050e6e2a4451df4 2025-07-24T15:50:19+08:00 Yunzhe Jia 1.sync with calrt prefill,decode,kv_update op 2.add hw pattern untile function
|
|
ba67d6c03fed3193987a4ef13050e6e2a4451df4 8f52c6f8abb2ed9ad967cc0bfb90acb073011193 2025-06-26T17:42:32+08:00 Yunzhe Jia llama-calrt: infer-op: copy data from output buffer to dst-tensor.data
|
|
8f52c6f8abb2ed9ad967cc0bfb90acb073011193 d2f325130c4ed77a3dcff2c23a926587fb08e2cc 2025-06-26T15:10:45+08:00 Yunzhe Jia Squashed commit of the following:
|
|
d2f325130c4ed77a3dcff2c23a926587fb08e2cc 6391ee7ffd97e723dfbdcc32f001e1b95a63cba6 2025-06-17T11:53:33+08:00 Yunzhe Jia calrt: add input_token in graph; input_token will be copy to calrt_in_buffer
|
|
b9850050a5b5147cb2e6720b98ed8c1e8e02eff9 933b205c32551848589b8339437d778cb4f2a46d 2025-06-06T17:25:52+08:00 Yunzhe Jia calrt: add call chain for using calrt::infer
|
|
33fea9a8592fd338abe279b89350a3af2e0ff1f7 806f05a353d322e97d97e02f910de2b408a8b4ab 2025-06-06T17:25:52+08:00 Yunzhe Jia calrt: add load calbin
|
|
806f05a353d322e97d97e02f910de2b408a8b4ab ec9e0301fef6476df83e94842c3b625501c95566 2025-05-30T09:45:37+08:00 Yunzhe Jia add calrt demo |