Files
calculet-npu-research-archive/history/llama.cpp/topics/calculet-authored/08-vision-multimodal.tsv
T

2.9 KiB

1f86112d6758298241ab2fa84ad4f0f7b1ace35c6d1bc743c10080fed1253686ce01749b42611ded42026-05-29T16:40:38+08:00wangbomengadd dump_pos,fix pos_tensor of pre_by_embeds
2f131bf1908b8c5dd1f49d7ae7f616506fc47166633d96dae28e17208ef61a71dba40cda3c04f135a2026-05-27T09:38:51+08:00wangbomengfix patch of qwen2.5vl,n_patch of minicpm = 64,fix n_ctx_slot,comment out M-ROPE
3a43741244a646d3f8fa3ff01bb9b7d059223d0a5b2003d6c90ef0fa26ab9e930ba3e22b355eb3d392026-05-15T14:39:53+08:00wangbomengrun llama-passkey successfully, fix llama-bench, copy 3 times input to infer qwen2.5vl
43b14ed556c15529fe1f94b649f49db7156dfaf67dde8b8228081769c8d8f1e0751d47fa7875f84232026-05-14T14:34:25+08:00Yunzhe Jia- Removed references to CALRT from clip.h, mtmd-helper.cpp, mtmd-helper.h, mtmd.cpp, and mtmd.h. - Updated server.cpp to conditionally include CAL-LLM support. - Introduced option LLAMA_SERVER_USE_CAL_LLM in CMakeLists.txt to enable CAL-LLM integration. - Refactored server context to handle CAL-LLM requests and responses. - Updated image processing logic to remove CALRT-specific implementations. - Ensured compatibility with existing llama functionality while integrating new CAL-LLM features.
5b2003d6c90ef0fa26ab9e930ba3e22b355eb3d397800c772d44a7415640ec1669a691232939927cf2026-05-13T15:24:24+08:00wangbomengtry passkey and embedding
67800c772d44a7415640ec1669a691232939927cfdde8b8228081769c8d8f1e0751d47fa7875f84232026-05-13T15:23:54+08:00wangbomengtry passkey and embedding
7dde8b8228081769c8d8f1e0751d47fa7875f8423fabcc7dac4b34d83fe430980bb364b81087c7ee92026-05-12T10:46:08+08:00wangbomengclip:add minicpm patch;
85eb46fffbd2e260c540fb112314ad67bbb8f56b6005112c51e00d998b457337ca3dad53fc46e2d0b2026-04-24T16:24:51+08:00wangbomengclip: add image_to_patches; calrt: vision copy data from bf16 to fp32
9005112c51e00d998b457337ca3dad53fc46e2d0b509670642e8090a1713f5d73590b549be827aaef2026-04-24T16:24:31+08:00wangbomengclip: add image_to_patches; calrt: vision copy data from bf16 to fp32
10e24f775ee26ea5249d5ff6cd23b8a0a17fe1438da206460e610aef995e36e50b33e8bd41fe4775412026-04-15T10:01:09+08:00wangbomengcalrt: add copy_data_to_ibuf for vision model
11a206460e610aef995e36e50b33e8bd41fe477541d8b2aaa00049978cebac15041f960d75b552f97b2026-04-14T10:23:43+08:00wangbomengcalrt: support mixture of prefill_by_ids and prefill_by_embeds
126dacdd2cf9574214ca272a86674e7bd7ba21c4f03e6ad64467771224f072e5bad90e270951ba4cdf2026-03-23T14:42:28+08:00wangbomengcalrt: add multimodal
133e6ad64467771224f072e5bad90e270951ba4cdfb37b7d9756feb3dac2db526eeab38b572a095d472026-03-23T14:36:41+08:00wangbomengcalrt: add multimodal
14d81d7b190ff5f21325167936496dfe5ab48b922ee492f5dc8cec17529f53ef2bbdf7b502107f8148 1f5accb8d0056e6099cd5b772b1cb787dd590a132025-11-04T14:43:32+08:00Yunzhe JiaMerge branch 'master' into dev
158f52c6f8abb2ed9ad967cc0bfb90acb073011193d2f325130c4ed77a3dcff2c23a926587fb08e2cc2025-06-26T15:10:45+08:00Yunzhe JiaSquashed commit of the following: