Files
calculet-npu-research-archive/history/topics/03-multimodel-model-lifecycle.tsv
T

13 KiB

1536aacd33ed5020b3fd7b34b1a71aac5c071d278b71c80d1686e204f1869b627e2ae49e96cd567852026-05-25T18:09:05+08:00patrickyangforce user to refresh device when ccu occurs error
251184d659f00224d1886d88e7e9970d4f3e9c03f303dbe04ef7264dc82650ec37b81bdec60ff15972026-05-13T11:05:04+08:00patrickyangfix bugs for obtaining lock to refresh device list
31e5c83a04c5ec02376bcda18a65ac9bed5d2c645c44088d0f28c50e0497da1699652d38682c9fab52026-05-11T17:50:19+08:00patrickyangsupport more debug methods. dump rt-calbin format files to recur bug
40529156cefd72eefb5d8542fc5523e9338c8851fc24adad2ad27e42a42711c11aa77ad28b20fad1d2026-04-21T16:27:19+08:00wantaoboupt multimodel runner.py init version
5d5f69845ea3373a69429eb7ff137b68986be4762e1b78ca05c96718e7e0777b724ad8ea5b61c09a92026-04-21T15:19:57+08:00patrickyangsupport rm device cpu share lib at configure
688c44271f155a3faec3b74252da8cdeb69d6fc76d3de4763a09d5913f5369991105d74e6d0ce04dc2026-04-16T20:45:08+08:00wantaobomodel runner: upt multimodel runner
7e512d11a92b724a25fa117117d79b9a6ecd4bfd3639fd246b8dc0cfb53bf1b4cad55772c3ca639a62026-04-16T16:45:17+08:00patrickyangfix calbin bug
8c267183d399f345b6be343c705bf6bf0f97585e0973e74a234003fad59c4da91cac6784406c607cb2026-04-08T11:01:54+08:00patrickyangfix refresh device list cause bus error
9258a335889c612e91f3bb0f594190c2060b8cad97f3f24b6359ec7475b9b0c5d4ba8ad2950cd9bce2026-04-02T16:05:21+08:00patrickyangensure nobody can refresh shared mem when some devices are under work.
101ca5844b795cb7407b2fc9df2021a03ffc927257f85400d4c88067269da8c40c676e1420eb9bb9092026-04-01T15:25:54+08:00patrickyangadd more protection to avoid force refreshing device list when some devices are taken by users and still running some jobs.
1141e2fa00f47bb109836241597371c4b49fa6107ec6f7c088d56ba4cbb4063fcd7819f64f0a195fd32026-03-26T10:22:02+08:00patrickyangadd check for failing to configure device and stop toward inference step
1279eeea1ea445ef00705a02b00237bf8d13641a506432a78725befee439fe8d7d4cb8f90bc135774c a2ee3e1194918b9562427a8469b039ab7c0663162026-03-06T10:24:29+08:00wangbomengMerge branch 'dev' into llama
13d74ec1bdce26866a53ca238a79b59949c4d765e82c9f4346f71ce3221b94fec8995bae7fd8f9f09f2026-03-05T15:22:20+08:00patrickyangupdate device and calbin for release mode
14ff6985086a30c2d2282cc14759a76a9c50e3e2926896e702a06c337a8413dc9fae88e9ddf76e1d662026-02-07T18:11:11+08:00patrickyangfix calbin check error
157fa2271219021a4dc9df5111b255dfbc0320387363ed7a129479697a4feca58ea1d8307f8f0140602026-02-06T11:13:44+08:00patrickyangtreat all .bin under calbin folder as param
169f91de70b8852666a12061a9042e2618e67ab98fe31e719a66354bb00eebaba21fe56836059253ba2026-02-06T11:13:02+08:00patrickyangupdate calbin to treat all .bin file under calbin as param
17e31e719a66354bb00eebaba21fe56836059253ba08f3a6159c3807465db5f5c74918e8ce85269a3b2026-02-05T16:52:58+08:00patrickyangupdate deploy function. now automatically refresh device memory each time when deploy calbin
18f49dd72b8fbe8252e228167e374797dda009604e5d29fa72e34fcbe8d783db35bcc9ed1416b41e772026-02-02T17:41:52+08:00patrickyangfix check deploy same calbin function issues
195d29fa72e34fcbe8d783db35bcc9ed1416b41e77a03c388d225f0229c4b5fb5ed8b1cab1a623c3bc2026-02-02T17:22:44+08:00patrickyangupdate function on detecting if two calbin is the same
20241054b3ae0f60a7c5208bea8effdb583c8394aaf07afa7936aabde4b9f9bf2fd1c938ecc2e2cc712026-01-13T11:29:58+08:00patrickyangadd csr offset check. add more details for calbin parse error report
21f07afa7936aabde4b9f9bf2fd1c938ecc2e2cc71d53816bcf9a81ec043f208e18532274201376f832026-01-12T17:49:46+08:00patrickyangfix calbin bug cause checking elf info at CPU acc type. rm auto-print commit version
225ac97e14b30a4d30de8eb11ef1801490ff96a9940538f3f91c9439bd78eb2693f3c535d17e4946772026-01-12T14:07:56+08:00patrickyangadd check for multi-chips calbin. Must come with cpu program
23a9b4c22037a2f88c5eba19eba42e84c5c295e2edd73d0ac515f2ab3bb3cf7020d4de8185b46f73be2026-01-05T14:59:55+08:00patrickyangupdate calbin to print csr info
24df1842115d1cde562a9f12a7b3ca41d34bcf1b0cabc38426e113fe16957c21c80ba7a8d513e36be42025-12-22T18:07:13+08:00patrickyangdisable tracer. Update configure workflow for dumping ini file
25d809f113e962b700ca6e910a757cf08a7cce637c5a789db708580144dd01d8202213c249532ae85d2025-12-22T13:39:59+08:00patrickyangupdate calbin. now seperate elf parse into an independent module
2657ffe19b41141dfb4cf5ca6042a869bf7ba401f58d35100526893078f2a47823b0d02e00bf89eece2025-12-09T20:41:58+08:00patrickyangupdate vdevice for reset device configuration. Allow to configure others calbin
271e1d375d56951b52843cabbd68b24480d554a2f6e919b71433dbfbab0b83c8ad4233d1519fb591882025-12-09T17:23:36+08:00patrickyangupdate calbin print error for less char size. improve configure performance for ccu with multi-chip
2815e39fec160368d935fcb7cbb9d4c00a96da0dab438999498de2618f55c73d98922e03184d3ebd8a2025-11-28T17:25:43+08:00patrickyangupdate calbin check for elf section
29438999498de2618f55c73d98922e03184d3ebd8a16d8256b407fe02450864c6f08a47e028e8d89692025-11-28T17:20:34+08:00patrickyangupdate calbin check for elf section
30282a7780eacd174725cd3dd43ae06647e176fb6a897156b46ffed9e914cff53d0b8f61cbce62a0272025-11-10T17:18:16+08:00patrickyangupdate for no i/o calbin case
31f62907dab76e22d9c6c91ace5f26fac8abcbb76cb036585627bb9ce958e07bca43be3ab52b5836082025-11-05T16:55:47+08:00patrickyangupdate calbin. remove test log
323dd38465558fe30592b4d80bff700cc853c4411c48724412c5f229c0264b32f02aa0f747c6339b7e2025-10-28T14:19:57+08:00ylsunadd calbin buffer test
33370a801782597b777fbdd2ebd304f4d1c04655cbfde109cbd6a58da3958438ea4ae4d8f81fc0348b2025-10-23T16:39:02+08:00patrickyangupdate pytest case for calbin and device
3456d67237c8eef2e97e2fb8d15e45d8c63f45c5601c30640be85373aa38a0978b10b9bc1bca8d21612025-10-23T16:37:50+08:00patrickyangupdate top level configure function to return error code in int. discard abort operation
352443be10eaa90c26dad56c2cddb720c6f2b37d2067f9297cf4e10b20676bd7e627c9c704ef1e91b62025-10-23T15:38:56+08:00ylsunadd pytest calbin test
3666526e06de83c6288e2f60416b0ef88002ee611d7e352fc83fb4308eb5ba13dc2ea51e765181b0942025-10-23T15:21:14+08:00patrickyangUpdate calbin class. support error code for feedback. when calbin creatation or initialization failed, would return nullptr
377e352fc83fb4308eb5ba13dc2ea51e765181b09445fb9c285a3b985b1983e578620478c43a5695eb2025-10-23T14:31:46+08:00patrickyangcalbin interface now would only return error code. Creation would not abort program but return nullptr if any error occurs during parsing calbin file
38dc7485db1ea5a2e5ff91bfa184652b02edacebc7d5045ccf4b0e008d6c52acd84c3aab591bd270622025-10-17T09:49:49+08:00patrickyangupdate calbin check. update DMA transfer size limits
398b60fa6cff51e510a2e368490af73f00a89ded2048fa3153427f338c6d0b8222c7ff8b95414b3cdc2025-10-14T17:30:38+08:00patrickyangupdate calbin and emu device
40fec5d8971e92b5c34f99695736d7ec9f290824190db1747f23e6fd12b5e4e4a90aeb8d40878327562025-09-30T13:41:00+08:00patrickyangupdate calbin and remove unsed functions
410db1747f23e6fd12b5e4e4a90aeb8d40878327564a9f1bf05029c931a5babebaef03b2956f3aadd52025-09-30T11:27:25+08:00patrickyangfix calbin bug when parsing .bss section
420cd78080791bb7e4f89b0f3ce222d2994d1aa02b30fc0c99f3cacd368daa5243eae58edaa7c4fcb72025-09-25T10:45:19+08:00patrickyangupdate calbin function
43a9115c6a2a4e78a913742b67e1aced6e0ce24e4d98dc19fd8c03b893ffd37ac428213982bdd4cff42025-09-24T11:00:14+08:00patrickyangupdate python interface for configure and infer
4401169a7a04e29266821d99063e74130d2ea6d5aa45ccc877f411385a3906e5bc80b830f6bb0d8b892025-09-15T16:49:59+08:00patrickyangupdate calbin search map
4545ccc877f411385a3906e5bc80b830f6bb0d8b894efc33f7101958ac44dd691e68628b945a0b04962025-09-15T16:09:37+08:00patrickyangupdate calbin performance at string handling
460ab8e6bea228ea49d757423d0aa915df3ce002d3b7362bad391fdb712d50153c1c4cf0033d3fc4d72025-09-09T10:08:38+08:00wantaobofix calbin_utils offset has no 0x bug
4711f66081c16fd40f68b78a4296001a8bd1ef61f19accfbc8cf66586bee53f5e99f31607b9174b1682025-09-01T15:20:20+08:00patrickyangupdate calbin map. update tensor check
4856da9c353adf990a8f00dc4630a33a668d81e28af508615c536e768722ec9940945f344e46d7dd7d2025-08-25T17:28:27+08:00patrickyangupdate configure to improve memory utiliation under single chip
49d3de3dede8387cdecc763c118180e9250eb532eae066f2feed67de75c041b77c46a85f79fd1ea0b82025-08-19T12:43:27+08:00patrickyangupdate calbin report function. it would report more info
50ff27cf1bd6db0080347b33168342c1dcda549f751d518b7d68435846a5ae528c13a8258df61dfcc82025-08-13T16:09:48+08:00wantaobo1. upt calbin utils with calcc_ver and device_ver_list, 2. delete print log
51e8376c8f09c270a7e93a88775c7bd90d9b1002833d3f907487b08913f38db89dca1054bd3544c9dd2025-08-11T18:06:05+08:00patrickyangupdate calbin object. more flexible to different device model
522767422ee6be145954ad33e910c2f06b1eca9916f916ab8bb95edca9962602e8397cddcf39b7222f2025-08-08T15:29:22+08:00patrickyangupdate configure function. add more check for kv-update
5367a827171a7b639dbc8477ce47f13993ed08b48962478f7825eafe925baa1b7e4b1d854151399f702025-08-07T18:28:18+08:00patrickyangupdate calbin. support report calbin file info
5462478f7825eafe925baa1b7e4b1d854151399f702d2380dd8f878444d01e735f5f2df4f4054c1be82025-08-04T17:49:59+08:00patrickyangupdate calbin Class. Now it is able to provide LLM seperately
55c4c747b7980329807b5636b84f6aff09de0435371a0318eac251cc15b761c48ace32851b3f2335112025-07-30T13:32:22+08:00patrickyangadpat uniformed calbin object interface
561a0318eac251cc15b761c48ace32851b3f233511fdaac0679919a6d811977440b1004f0dfa5b93732025-07-30T11:30:57+08:00patrickyangfix confusion caused by calrtcalbin and calbin parser. Now uniform into one way. All informations related to calbin file can only be obtained via Calbin object
57d4bfff9265c45053343841968cfceb75f2393ca2266bfab5ced6abb9c2b4019879f3bc3aca5ea15a2025-07-10T17:40:07+08:00wantaoboupdate calbin utils
584417785bc57b4112b55018d0aac677b313b640cdc7cbed02bb2ba8ab4d9465b66ed1ddebbb8563442025-04-24T10:18:12+08:00patrickyangadd check data function [temp] for debug usage on pld. Fix bug cause not able to configure derived class device
59273a72072d567f57442edc12ef2b1f4e228dd3c1bacc578dbfeaa2e2c558b9905aff547810aefae42025-04-16T14:40:05+08:00patrickyangfix potential error may cause storing dudplicated infomation from parsed calbin file
6092a46765b5bc32394e3473df56fcf45d6c6ab112ed8bc3cd2b0e65452b236d5480217d106ebbce292025-04-15T12:05:36+08:00patrickyangadd reserved mem info recorder. Add thread safe for multi-threads allocate mem. improve log system during parsing calbin and deploy. Implement callback function in Job class to release sync unit
61eda04f64a76defe9f5b1e15f04e623cd7ca0cbceaa45692d886823173d547ed60dd1f4d8fb4fd86d2025-03-31T11:26:51+08:00patrickyangadd shutdown to job engine destructor. remove get allocator function. add constrain during parsing calbin
6294f4ecce199c50d0057c73c55f87bc50ba73e60ba8bc609a86b1b7dd71e5191d5fe42fd1414afc4c2025-03-21T16:35:15+08:00patrickyangimplement brand-new deploy process. Provide brand-new log system. establish trigger device function. enforce calbin parser ability
63eb55b380d0100d6836d7684295acab50f094762133b761a14deb330225bd5de2a102465d805884422025-03-14T14:35:11+08:00wantaoboupt calbin parser in deploy.h
6496e8a2b3ea337a82a5d13e0549151a242067a5441d514528fa7d3a07bba20233db1c38575262e1902025-03-11T14:26:47+08:00patrickyang[deploy] adjust to new calbin structure
65eddc4c5c6bd9b2717dcf421e3c36b024c3450c21445e2814d0894e2441af1e8136d5ddbf12f2069d2025-03-07T14:09:41+08:00wantaoboupt calbin structure
66a3c86bb9a99f1d9395c567caa44acec038ab26268e137dd375a839628b50b35a8240234b140fd6542025-02-26T11:33:59+08:00patrickyang[calbin parser] fix syntax error
677613fea926c30047d7b7965fd53f27fec70fb160a71affc1331d7d956eeeddda343cfdd9c477914c2025-02-10T15:37:19+08:00patrickyang[loadingCalbin] implement parsing from calbin to fill tensor data shape struct
68a71affc1331d7d956eeeddda343cfdd9c477914c0b78f61a5f2d6fe5bb02e9fa85e1ac3f5511cafa2025-02-08T17:42:01+08:00patrickyang[calbin parser]
690b78f61a5f2d6fe5bb02e9fa85e1ac3f5511cafaf0e52053960dab10e5f003305daf2c630e6c527d2025-02-08T16:34:07+08:00patrickyang[configure]convert single chip configure pseudocode to real code. fix typing error in deploy header file.
70f0e52053960dab10e5f003305daf2c630e6c527dde7b07261e17991cd6ae9f4ccd5be448773993b22025-02-08T16:31:55+08:00patrickyangimplement travel from top calbin folder to the depthest and Parse calbin data(modify when standard settle down)
71abae6b793b02356440d2d00d2017b6d18c7b64afd602538ce2bd5240fd2f8fcb65771eaa2f1795e02025-02-06T16:05:58+08:00patrickyangupload calbin parser
72d602538ce2bd5240fd2f8fcb65771eaa2f1795e0fe2d1296e118d9375a776bc26843d83803fb85572025-02-06T15:56:01+08:00patrickyangdecoupling calbin parse function and data struct return function
73fe2d1296e118d9375a776bc26843d83803fb8557fd95ca93f95540651a6205143507139c2ac9eb1b2025-02-05T18:36:15+08:00patrickyangcomplete calbinSchipNetwork assign; Developing parsing calbin files from amount of folders -- travel all chip subfolder
74fd95ca93f95540651a6205143507139c2ac9eb1b6342c738a533a351579c52962657624c9120d1552025-02-05T17:22:36+08:00patrickyangparse calbin file; assign calbin data struct
754342114e72397bf16992214a37fd34aec9f70ac7326ab67948444fb4cc4c36370e3eeee5cd5f66ab2025-01-03T11:32:16+08:00patrickyangdeploy pseudocode with same ccu and cpu program. All info recorded in calbin file
76ac62ed7e1d7da2a79839588867f50f8c29a8a15e42dd6d782800e7adab6c26f95fe410a212ddb38a2024-12-24T12:18:20+08:00patrickyangupload some brainstorm about needed struct from calbin file