37e65977fb05e671b1acfb4a11e96d2d6a3a5839 cde1d40fc252240b2ccdab0785d53e3643f84193 2026-05-29T15:45:23+08:00 patrickyang fix atomic memory order issues 6f95f35af17c11e7addfc22a6938dc4517d5be64 51184d659f00224d1886d88e7e9970d4f3e9c03f 2026-05-13T11:30:19+08:00 patrickyang fix refresh bug. failed to refresh memory. failed to obtain shm lock 58f7d948f15f0f10989e3ff82ff5aaf029ef1b19 83c434001d8dcec264abd87c1d5abf5ee6195699 d2f11fc9077e6a84662eb4aa554b36939858ee87 2026-04-17T09:41:52+08:00 Yunzhe Jia Merge branch 'dev' of http://192.168.10.26:1000/taobo/calrt into dev e6c697b4cc5e99a902332322272d75e0d9a4ac16 f2aef1942611069afac2b50604d48512ecb9ad60 2026-04-15T09:48:59+08:00 patrickyang add assert for past kv seq len less than cur seq len 616337c570262b3ae1c90ed5c473b426e86484b4 b5edb72053bf7a54691f0457628b520399e547c5 2026-04-13T11:27:06+08:00 patrickyang refactor deploy ccu data. improve memory utility. provent write device restricted memory 7d76e34e5388905fa35b20c810b4fdd4f8b343ab 325dd2d9e4f1c9ddbcfc5314b266fb9f1f22abee 2026-04-07T16:15:33+08:00 patrickyang support to read write device memory for virtual device 325dd2d9e4f1c9ddbcfc5314b266fb9f1f22abee 75d32605166604a1915837a575676266dd415a58 2026-04-07T16:12:39+08:00 patrickyang upt read and write remote chip memory 75d32605166604a1915837a575676266dd415a58 043c157b5cc391585b28371736678555c56a673a 2026-04-07T16:11:53+08:00 patrickyang provent user accidently write os memory space ce489be9dd92aa2fd97248159446466ac1b982e7 258a335889c612e91f3bb0f594190c2060b8cad9 2026-04-02T16:06:07+08:00 patrickyang upt cli function about read and write memory. support different deviceevice and chips c8942310d4b1072505766c3779a3f988f7f983a2 1ca5844b795cb7407b2fc9df2021a03ffc927257 2026-04-02T15:59:33+08:00 patrickyang support read remote chip memory. support ring buffer to deploy weights in 512MB mem usage a08691bcfd18262118d1f4ab9c8027884f5b43be 22c7d2fab85df22acaf90cb184dc5385290dc903 2026-03-31T15:50:31+08:00 patrickyang enable init mem allocator by product number 9b946dfdbbe843728b7fc6cecc340144a08fa7e7 3d553b0918d7c0afb22fa837d50b54216ea5e3d0 2026-03-10T16:34:12+08:00 Yunzhe Jia fix kv issue e4bb637a5d7fb3b7d80b8be4cff3bde3745fa306 80b5bec7c0bfcb4ba4c5145b15b811f41a67d896 2026-02-10T19:28:43+08:00 wantaobo upt pastkv bug 80b5bec7c0bfcb4ba4c5145b15b811f41a67d896 8cfa512ffbb271f1ab952649b7a0692abe75b21f 2026-02-10T17:47:43+08:00 wantaobo upt pastkv model runner d42879ffdfc48c015dd386fb5dae89bfe6d3f012 e9f95f4f06bf0742eda6649a322f327c2dfa5b38 2026-02-06T15:40:11+08:00 patrickyang implement past kv model runner 8eb0217d081caad6ea550075909048beee90778c 9f91de70b8852666a12061a9042e2618e67ab98f 2026-02-06T15:37:25+08:00 patrickyang implement past kv model runner e31e719a66354bb00eebaba21fe56836059253ba 08f3a6159c3807465db5f5c74918e8ce85269a3b 2026-02-05T16:52:58+08:00 patrickyang update deploy function. now automatically refresh device memory each time when deploy calbin 08f3a6159c3807465db5f5c74918e8ce85269a3b f52b519897fc32cace5fc878170ae22821975d5b 2026-02-05T14:43:00+08:00 patrickyang remove device address with offset a298898a064a9f854d021597827ec4d84d09d3e4 78e5765d213aa9a095604efac528a63c9f4eb807 2026-01-04T14:01:17+08:00 patrickyang fix bug causing segmentation fault due to mis-manage buffer life time 1f96edfc0a223fa4c79816edcf28ca8f934ab246 df1842115d1cde562a9f12a7b3ca41d34bcf1b0c 2025-12-29T16:37:47+08:00 wantaobo [model runner] update hparam to cur_seq_len and past_kv_cur_seq_len ab5a3bd62c0931d5f382f7fba16e115961e9c796 2ef07a46f910fbc81798bd7da2ef965f8c92669b 2025-12-18T15:17:04+08:00 patrickyang output buffer now support more status check for ccu failed to exec a677677e8660a454c46691effe181374d7a393a0 d752424487a03856b3ba765ffd7d5550261d39b4 2025-12-15T15:04:58+08:00 patrickyang support print ccu prog addr with virtual addr and physical addr d752424487a03856b3ba765ffd7d5550261d39b4 fe0bcf650a3f3782bc51b44a0e60fc47f2f3c2d1 2025-12-15T15:03:47+08:00 patrickyang support read ccu program start address e919b71433dbfbab0b83c8ad4233d1519fb59188 240646b084e02e6b90ea82073198a2b13e1bc68d 2025-12-08T16:41:06+08:00 patrickyang update buffer to init hyper-param 0389ad48db464669155ff423b9eb5efbb189c8a8 5015afd73c96d28c875d7250c85c79676afadb70 2025-12-04T10:52:25+08:00 patrickyang fix allocator bug for no corrctly free memory 16d8256b407fe02450864c6f08a47e028e8d8969 068288e034eb11d6056d8fa68b2cc9e54f63818a 2025-11-27T18:01:07+08:00 patrickyang allocate ccu1 align 1kb size 9f551dd8a40c3855e65e8cea6812515655d67c59 90747c80fe69a6cffe5ddeca4a70b6538f3e1594 2025-11-13T16:21:36+08:00 wantaobo upt demo for tensor address check for both dram and sram 321da3e562974471bf50af7a5650f1dd60f8e50b f62907dab76e22d9c6c91ace5f26fac8abcbb76c 2025-11-05T18:00:50+08:00 patrickyang update python buffer interface d148f07d1c4d86199ea88265e7f31575dbb2ab7a be6a6f8abdb02ff7b22377147ade0cb13b87c2a5 2025-11-04T14:42:48+08:00 patrickyang support memory write by ptr ccf054ff5147b5291d5f9b697e74a36173e8c660 b6490722cf48f1de5fce4d11308badfd3f673c87 2025-10-28T14:58:02+08:00 patrickyang provide get model config info and kv cache info interface. 3dd38465558fe30592b4d80bff700cc853c4411c 48724412c5f229c0264b32f02aa0f747c6339b7e 2025-10-28T14:19:57+08:00 ylsun add calbin buffer test b8430b8c13022f8448ca049823f5bd8d0864919d eca251cb15521e2df9d3c15c584902fe7a3e4355 2025-10-15T17:24:13+08:00 patrickyang stop tracking files under __pycache__ 8dc5c264532840a87e865389b60e1b46a82643cf f90b5e2a6d0928e1f533b6d814c6a7e388e70fcc 2025-10-15T09:59:49+08:00 patrickyang update io buffer memory check f8f3b91034ce45c174b825191b188b3511e6dad5 67d7cb8dbfb9a7fd265982086a8012433ed53ea2 2025-10-13T16:22:53+08:00 patrickyang update i/o buffer check c6937e3caa1e7447c8162acd3172d6a017a4f5c0 0fd75f0b76ed5c482db7e7355da457f94a781887 2025-09-30T17:52:14+08:00 patrickyang update tensor and buffer 0fd75f0b76ed5c482db7e7355da457f94a781887 0e36a3ec8c26ccd7f4dd956a9f230591b61a594b 2025-09-30T15:53:12+08:00 patrickyang update buffer 5fc8080bdff8b5360046be3e6fecaa321378b2e4 3d908daffbe91915f238cce601e207e27ab65625 2025-09-17T15:32:10+08:00 patrickyang update memory reservation 66e9254a9a90042ac8a6eb9529a083fab21880bc 18c9cb15118f87968f1fb47e1cbd9738289005e7 2025-09-13T16:20:06+08:00 patrickyang implement dump device memory, etc info into bin file. 56da9c353adf990a8f00dc4630a33a668d81e28a f508615c536e768722ec9940945f344e46d7dd7d 2025-08-25T17:28:27+08:00 patrickyang update configure to improve memory utiliation under single chip c993bbcb42f564276f47372c2d076a7ab31b1f40 3b3365ead89280728d3418d9bc1a447b74f8cb2e 2025-08-19T15:40:08+08:00 patrickyang update output buffer status 1e32fe04b9ed06993cf6b238a45a13303e4791e3 046cafe33cf5f0f31d5748a3b8bf71ac0e865db1 2025-08-19T12:46:22+08:00 patrickyang update allocator. disable NBU_CHECK 3d3f907487b08913f38db89dca1054bd3544c9dd fe1cb970af003441d7b26ed3ddcc2ce101e32d7a 2025-08-11T15:45:58+08:00 patrickyang update kv cache specs 466c8f2784675906b51f97c4295748460f70834b 6f7e8ebfd73c7b1eb218eab561bdc63d184dc372 2025-08-08T16:44:24+08:00 wantaobo upt kv_spec support 2767422ee6be145954ad33e910c2f06b1eca9916 f916ab8bb95edca9962602e8397cddcf39b7222f 2025-08-08T15:29:22+08:00 patrickyang update configure function. add more check for kv-update 2a8983673735ad5610670f87643971123af43aef 049d755ed8e8205ae7c3df0381672eda832657c4 2025-07-31T16:16:23+08:00 patrickyang fix error causing reset all memory information including OS. Now when reset device memory, only OS mem info is reserved d41c5794e5771758a9b54f5efc0b5a774e6f35f6 fae87906d397c98ec5505db70a5334bd93272fbb 2025-07-24T09:01:47+08:00 patrickyang fix buffer construction issues 5984865633c837dd8df76f0c5aebb2237e0d0afd 6c41e148980c7d047cb76dce7da7dfd31d26c036 2025-07-16T17:36:01+08:00 patrickyang fix potential issues trigering by parsing kv info a59a56dc38555f02280599f459d68df6a51e5d5e c91bb35ea325310467f9468d67c61e16fc590565 2025-07-11T18:44:38+08:00 patrickyang update calrt input buffer. provide kv cache interface d4407cb779f738d1fe7e18b08187c6bc03587894 056cb015cd60a45a31b9b9279aa009e72424bcd8 2025-07-10T18:05:01+08:00 patrickyang enable to parse and print kv cache info. [temp] a5e2ef41dc68ebff2a3eaf41443eaf3eddd21eda 32266fb7d2389cbbbf53be6ae9bb31cf318a0b73 2025-06-12T17:48:15+08:00 patrickyang support allocate sram memory. support deploy ccu in sram. support reporting sram memory usage 5751843b9ac30f91b68b99eb030669c3e5e27dea 170c4e10f294d1fa4c7f073c008418b762c88708 2025-06-12T10:51:46+08:00 patrickyang update set MHCR for flush cache in non-os env pld 4db69c7daabab11fb97c7cf1ac519ae02363a0fb 3bc24613cd34276136ee8b2893b3ec626f74872c 2025-06-05T16:05:11+08:00 patrickyang [refactor RT] remove unused header file. re-organize device class and vdevice class. Uniform interface of create calculet device. Display static of device memory usage. lighten header files. 5e1fe1ad5ba6cebf076002590e31322b3fae0ea0 e934463f0408e2a238ce88d423cbc0bffadb0d1f 2025-06-04T16:23:29+08:00 patrickyang fix potential issues causing elf ddr address wrrorng 7c9ef26bcb1c36b9f8ce987ee39118d668b663a1 596fd8b1d7043bf7a9abc4ade36ae86e9722ae33 2025-05-30T11:11:56+08:00 patrickyang refactor name style. free allocated memory from inferlanucher a362ef95425d09dcad988f1e6e93534e4e354d8b c7cbed02bb2ba8ab4d9465b66ed1ddebbb856344 2025-04-25T19:33:45+08:00 wantaobo upt demo for memory reserved info 523cbc0385db6ee32a6eafff643638c3cef0a25e b363e285c0502846b769a09cfcfe3fa56e9ed878 2025-04-16T17:32:44+08:00 ylsun fix calrt memory copy to/from device tensor size bug cf943662338348b240d900c477016adee1d824df 273a72072d567f57442edc12ef2b1f4e228dd3c1 2025-04-16T14:45:07+08:00 patrickyang fix duplicated vaddress convert bc6c7b7180999296b8ac7b3ffe1b0780c09145f4 92a46765b5bc32394e3473df56fcf45d6c6ab112 2025-04-15T17:01:20+08:00 patrickyang update boundary check for i/o buffer. fix calback function error, leading to bad function call 92a46765b5bc32394e3473df56fcf45d6c6ab112 ed8bc3cd2b0e65452b236d5480217d106ebbce29 2025-04-15T12:05:36+08:00 patrickyang add reserved mem info recorder. Add thread safe for multi-threads allocate mem. improve log system during parsing calbin and deploy. Implement callback function in Job class to release sync unit ee3b24212fc1a184183341ccb1ccab4917fa878b e56664b044ab808dea2194f731e8afa700438a39 2025-04-11T15:41:43+08:00 patrickyang add offset for input buffer and output buffer eda04f64a76defe9f5b1e15f04e623cd7ca0cbce aa45692d886823173d547ed60dd1f4d8fb4fd86d 2025-03-31T11:26:51+08:00 patrickyang add shutdown to job engine destructor. remove get allocator function. add constrain during parsing calbin ddb137f6337b5705d4e4b49e4bf0e3e09395ce6d b9b0b417e0f3853050551f55017a91c5186a18ae 2025-03-28T17:12:08+08:00 patrickyang add switch for memory monitor 78ed2f51fe0f8fdfd6e40cc4039bb809c7cd84c9 2f0e0d67ff7a4960c5210324e2cb7e55ba95176a 2025-03-28T17:08:06+08:00 wantaobo calrt gen infer launcher, udpate Jump addr size bug e2342f3d8e660395d8e66686f4bd25a760e89b1d 671e780c47bd9f43bb7a57af627739431b03d2d5 2025-03-27T17:26:15+08:00 patrickyang add constraint for i/o buffer 78e3170622a41040c1697c5fe450728268765483 3f6c6352cfffa5954c1ea6bf407eeeeda6180bce ea7595ba1b1f1dac427392c6249df8fb49e10ef7 2025-03-26T14:59:03+08:00 patrickyang implement parse elf function as template to parse either 32-bit ELF or 64-bit ELF. Enable stream for loguru. Improve fmt_custom for error reporting. Constrain i/o buffer ping-pong address 3f6c6352cfffa5954c1ea6bf407eeeeda6180bce cccd106b6f883926393bfc9d9fda6f9b4e0fdd70 2025-03-26T14:58:06+08:00 patrickyang implement parse elf function as template to parse either 32-bit ELF or 64-bit ELF. Enable stream for loguru. Improve fmt_custom for error reporting. Constrain i/o buffer ping-pong address cccd106b6f883926393bfc9d9fda6f9b4e0fdd70 2ab8eaaecebeb4f1e175b93e8f3f07d41f451eab 2025-03-26T10:14:20+08:00 patrickyang update allocated addres align to 1MB 2ab8eaaecebeb4f1e175b93e8f3f07d41f451eab 5ae0649f977e4ff80c677e9a9c1f35c447237e63 2025-03-26T09:33:55+08:00 patrickyang add memory check for i/o buffer be68ee70c4729e0e145789ee3372259815658117 adcacad8eff12ffc9ce1b9e3fc10443a118a5f53 99ce200bc4bc220c308126a8258fe81ee2046bc9 2025-03-24T19:29:55+08:00 patrickyang update allocator with mem table adcacad8eff12ffc9ce1b9e3fc10443a118a5f53 b011b5d4e71eaf0ffb55aab0025d13327699ddd3 2025-03-24T19:28:36+08:00 patrickyang update allocator function 99ce200bc4bc220c308126a8258fe81ee2046bc9 b011b5d4e71eaf0ffb55aab0025d13327699ddd3 2025-03-24T19:25:09+08:00 patrickyang update allocate mem table 83337a6eab233a3c7a99beea7646724145251957 c77e0b84359c58671a29e96cf2a95d7d5e4d2b7a 2025-03-24T17:56:36+08:00 patrickyang update calrt_allocator c77e0b84359c58671a29e96cf2a95d7d5e4d2b7a 1c6a3c94dde7f6fc475daf8f81d609aa027fc9fa 2025-03-24T17:28:02+08:00 patrickyang update interval map for register allocated memory info 1c6a3c94dde7f6fc475daf8f81d609aa027fc9fa 9d02f6a5442f1ddd9dcd66298adb20552bfe6f6e 2025-03-24T17:27:30+08:00 patrickyang update calrt allocator df817cd7e4495c95afb71276063dbd80349f98c8 212e409009b43dff8149d1ff64cf510beca00b0d 2025-03-21T17:52:31+08:00 patrickyang bug-free 212e409009b43dff8149d1ff64cf510beca00b0d 95f48576f70e3b8072aac0c722e5ba3cde576edc 2025-03-21T17:47:08+08:00 patrickyang add memory state cmd bff6fc00d9010fbe70af1ae4565bdb81e6d4b086 a73d34d8856f499649fa1e9ffd75a226fea5d71d 2025-03-21T17:31:43+08:00 patrickyang fix ccu0 place addr 5f81d2d20ec60bfadeb123d57cb8ff159e4dc4dd 50ffd30c3c878f522f10ae5338c0453dec12e279 2025-03-13T15:31:01+08:00 wantaobo udpate emu device to add bar2 base addr 66cbb77609120008ee4ac252d66cffba6b887b52 e609d9efc620abf28402d3ad46be83ee7f0aa438 2025-03-10T11:49:22+08:00 patrickyang encryp compiler::allocator to calrt_allocator 47c825dba1fff93a8da32c51885f4268b8c26be1 862de6768c409de5ea58b6c1f813b76b04b5a044 2025-03-06T17:12:44+08:00 patrickyang update deploy so, and allocator ed2470f069381d474ae5c83c55075be40c136233 9d5271feffba66cf420479dcdffbff7cdd59e9d0 2025-03-05T14:37:27+08:00 patrickyang [Mem allocator]introduce device memory allocator. 09be6d18a5adc9ef015b63ef0280feeae21544a2 6fe49ba5582f46a3e545078026abce3aed4807b5 2025-03-04T17:51:44+08:00 wantaobo change name stream to buffer a182db9d0891476462344813c1e09c62fe24ef4b fbf6377a2c66a5e73bec071f05b4a1edfeb663cb 2025-03-04T11:26:10+08:00 patrickyang update from uint64_t* to uint8_t for host address ce9efecf56d26417faf2d6d3de6bf5cb9bd27d5e 9af274bc7bac7b57738675876a1414a560b30f77 2025-01-23T17:51:36+08:00 patrickyang introduce allocator to device class; discard never-used files