TSC
TSC Voting Members
TSC Chair: Liya Yuan
Company | Name | |
TSC members | ZTE | Tao Liu, Shiying Jin, Liya Yuan |
China Mobile | Qi Sun | |
China Unicom | Haoran Wu | |
ICT,CAS |
TSC Meeting Info
Adlik Technical Steering Committee meetings are open to the public and held every two weeks on Tuesday from 12/03/2019. You can see Adlik TSC calender and subscribe to its mailing list adlik-tsc@lists.lfai.foundation which will send you TSC meeting information on https://lists.lfai.foundation/g/adlik-tsc.
The TSC meeting agenda is published prior to the meeting. If you have a topic that you'd like to discuss, please email your requested agenda item to adlik-tsc@lists.lfai.foundation to be added to an upcoming meeting.
Zoom Details
Topic: Adlik TSC Meeting (Bi-Weekly)
Time: 03:00 PM Beijing, Shanghai
Every 2 weeks on Tuesday until Oct 18, 2021
Join Zoom Meeting
https://zoom.us/j/3667818723
20220322
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Liya Yuan |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Self-developed engine in progress.
- Bert inference on Intel Xeon 8260 in April
- Torch runtime support in June
- CPU test done, GPU in progress
- Serving framework will be easier to use
- Oneflow integration in progress
- Model zoo is open for trial
- Open discussion
20220308
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Liya Yuan |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Optimization of Yolo5 has been completed, including code and blog
- Torch runtime will be commited by the end of March
- Oneflow integration
- Model zoo is in progress
- Open discussion
20220208
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Open discussion
20211214
- Zoom meeting:20211214.mp4
Roll Call
Company | Attendee | |
TSC members | ZTE | |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Open discussion
20211116
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Open discussion
20211019
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
Have been applied at CMCC Xi’an application for classification of encrypted traffic
Next
Auto Scheduler based on TVM int8
Auto optimization by introducing ZenNAS
Aim to have a whole pipeline from training to inference
- Open discussion
20210907
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Open discussion
20210713
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Liya Yuan |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- TF-TRT benchmark test - In progress
- TVM benchmark test - In progress
- Paddle detection framework collaboration
- TVM inference engine optimization - template auto generation.
- Open discussion
- Need to build better ecosystem.
20210629
- Zoom meeting:20210629.mp4
Roll Call
Company | Attendee | |
TSC members | ZTE | Shiying Jin, Liya Yuan |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Cheetah version was released on June 21th
- Will be working on:
- Uploading docker image of Cheetah version
- TVM benchmark test
- Paddle runtime integration
- TF-TRT benchmark test
- Self-developed inference engine
- Open discussion
20210601
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Open discussion
20210518
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Shiying Jin, Liya Yuan |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- In progress of paddle integration, paddle team has commited some code; will deliver a speech in Wave Summit on May 20th.
- TVM integration in progress.
- A new repo was created for object detection model optimization, now YOLO is under study for the target.
- Open discussion
20210323
- Zoom meeting:20210323.mp4
- Presentation:Presentation.mp4
Roll Call
Company | Attendee | |
TSC members | ZTE | Shiying Jin, Liya Yuan |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Model compiler: Paddle will support being converted to other formats; Performance validation has been done for paddle runtime.
- Model optimizer: Release 0. 2 was published.
- Invited talk
- Overview of TVM - Ruitao Qiu
- Open discussion
20210226
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Liya Yuan |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | ||
Other attendees | CAICT | |
China Telecom |
Status of open action items
Work report and plans
- Will carry out coorperation activities with Paddle recently.
- Model compiler: A new release will be published this week.
- Model optimizer: Will add optimization specifically for YOLOV4.
- Inference engine: Will support TVM.
- Plan to get graduated before the end of the year.
- Plan to integrate several features of ZTE inference engine.
- Open discussion
12/17
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Kaili Zhang, Liya Yuan |
China Mobile | ||
China Unicom | Tengfei Liu, Yuzhe Cui, Longshe Huo, Zhili Xu, Yunfei Cao | |
ICT,CAS | ||
Other attendees | CAICT | Zheyu Zhang, Shuo Liu, Yueming Meng |
China Telecom | Shujv Fan |
Status of open action items
Work report and plans
- Open discussion
12/2
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Shiying Jin, Liya Yuan |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | ||
Other attendees | CAICT | Zheyu Zhang |
Status of open action items
Work report and plans
- Tao Liu introduced status and features of release V0.2.0
- A demo presentation was delivered to China Mobile about the new features of Adlik. Will follow up to see if there are any new requirements.
- Introduced summary of the features delivered in the last two weeks and plan for the next two weeks.
- Recommend to communicate with Paddle about the technical direction we want to collaborate on. Will have a speech in the late December.
- Plan to deliver a demo for China Unicom.
- Discussed with AIIA about their concerns.
- Open discussion
11/16
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Shiying Jin, Liya Yuan |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | ||
Other attendees | China Telecom |
Status of open action items
Work report and plans
- Bear release (V0.2.0) will be published on 11/20, release Note: Adlik Bear Release (V0.2.0)
- Open discussion
- Will start to plan for the next release.
11/3
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Shiying Jin, Liya Yuan |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | China Telecom |
Status of open action items
Work report and plans
- Release:11.16, release note almost ready
- Model optimizer&compiler: Compile all format; support pruning and quantization on Raspberry Pi
- Serving engine: Cloud native
- In next release: devops of Models, compiler for x86 and other hardwares
- Release:11.16, release note almost ready
- Open discussion
10/20
- Zoom meeting:TSC-20201020.mp4
Roll Call
Company | Attendee | |
TSC members | ZTE | Shiying Jin, Liya Yuan |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | China Telecom |
Status of open action items
Work report and plans
- Model optimizer
- Serving engine
- New release in the middle of November, key features: Cloud Native, new architecture Compiler
- Open discussion
09/22
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Liutao, Liya Yuan |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | ||
Other attendees | China Telecom |
Status of open action items
Work report and plans
- Model optimizer: Albert optimzation, model distillation
- Serving engine & Cloud native(ZTE K8S, provide APIs, dockerfile v1 almost completed), will have a new release, Yolo runtime optimization & benchmark, a customized runtime
- Will publish articles every two weeks.
- Open discussion
09/08
- Zoom meeting:TSC_20200908.mp4
Roll Call
Company | Attendee | |
TSC members | ZTE | Liutao, Shiying Jin, Liya Yuan, Chengcan Wang |
China Mobile | ||
China Unicom | Tengfei Liu, Zhili Xu | |
ICT,CAS | ||
Other attendees | China Telecom |
Status of open action items
Work report and plans
- Model optimizer:
- Serving engine: Yolo V3 model with different runtime, performance test in progress, considering performance boost via compiler optimization; Albert model tensorrt&tf lite finished; Cloud image finished and being test, considering registry. AMD GPU testing.
- Model compiler: 8 bit quantization merged (size smaller, performance didn't meet expectation)
- Invited talk: CubeAI
- Open discussion
08/25
- Zoom meeting:TSC_20200825.mp4
Roll Call
Company | Attendee | |
TSC members | ZTE | Shiying Jin, Liya Yuan, Chengcan Wang |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | ||
Other attendees | China Telecom |
Status of open action items
Work report and plans
- Model optimizer:
- Albert pruning in study.
- Will study model distillation.
- Model compiler: Bert (Pytorch →ONNX finished, tensorflow serving → tensorflow lite in progress) and Yolo model (conversion to serving GPU finished, dealing with exceptions when converting to serving, issue raised to openvino regarding converting to openvino)
- Serving engine: Cloud service image for company network was finished, version for dockerhub is in progress. Plan to support AMD GPU.
- Model optimizer:
- Open discussion
- Invited China Unicom to introduce CubeAI.
08/11
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | |
China Mobile | ||
China Unicom | ||
ICT,CAS | ||
Other attendees | China Telecom |
Status of open action items
Work report and plans
- Release plan:
- Model optimizer: Documentation
- Serving engine: New issues, image, AMD GPU support, Integration with Paddle, Model compiler 的openvino版本合入。
- Open discussion
07/28
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Shiying Jin, Liya Yuan |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | ||
Other attendees | China Telecom |
Status of open action items
Work report and plans
- Release plan:
- Model optimizer:
- Serving engine:
- Open discussion
07/14
- Zoom meeting:
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Shiying Jin, Liya Yuan |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | ||
Other attendees | China Telecom | Yuan Zhang |
Status of open action items
Action/ Further study on possible solution for mapping, procedure to apply Adlik in ORAN. Propose a CR for ORAN standardization.- Has been presented at ORAN weekly meeting.
Action/ @Tao Liu for documentation on interface description.- Will be done along with other documentation, suggest to include all of them in a doc folder.
Work report and plans
- Release plan:
- Cloud service; Auto pipeline; FPGA runtime; Tensorflow TensorRT/Paddle Lite/ TNN, etc, ARM toolkit, Optimizer; Auto Pruning; Benchmark Test( new features)
- Model optimizer:
- MobileNet demo
- Serving engine:
- GPU Cuda 10.2; Openvino upgraded; Keras, Tensorflow, ONNX, TensorRT
- Release plan:
- Open discussion
- Jessica: Diversity, cordination with other LF AI projects, meeting schedule
06/16
- Zoom meeting:TSC_20200616.mp4
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Shiying Jin, Liya Yuan, Wei Meng |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | Yuwei Wang | |
Other attendees | China Telecom | Yuan Zhang |
Status of open action items
Action/ Further study on possible solution for mapping, procedure to apply Adlik in ORAN. Propose a CR for ORAN standardization.- Has been presented at ORAN weekly meeting.
Action/ @Tao Liu for documentation on interface description.- Will be done along with other documentation, suggest to include all of them in a doc folder.
Work report and plans
- Release management:
- Released on June 15, PR from LF AI https://lfai.foundation/blog/2020/06/15/adlik-0-1-0-release-now-available/.
- Model optimizer:
- Serving engine:
- Release management:
- Open discussion
06/02
- Zoom meeting:TSC_20200602.mp4
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Shiying Jin, Liya Yuan, Chengcan Wang |
China Mobile | Jie Wu | |
China Unicom | ||
ICT,CAS | Yuwei Wang | |
Other attendees | AIIA | Shuo Liu |
Status of open action items
- Action/ Further study on possible solution for mapping, procedure to apply Adlik in ORAN. Propose a CR for ORAN standardization.
- In progress, 3 CRs will be presented at ORAN WG2 AI/ML meeting on next Monday.
- Action/ @Tao Liu for documentation on interface description.
- Will be done along with other documentation, suggest to include all of them in a doc folder.
Action/ @Liya Yuan to contact with AIIA open source group to find out the requirements and solutions.- In progress, an automated benchamark test solution has been proposed.
Action/ @Tao Liu to prepare for online video introdution to using Adlik.- There will be 2 events where we can promote Adlik, will be recorded as online video.
- Action/ Further study on possible solution for mapping, procedure to apply Adlik in ORAN. Propose a CR for ORAN standardization.
Work report and plans
- Release management:
- Will be released on June 15, draft PR has been sent to LF AI.
- Features of Model optimizer,Serving engine,Automated test can be found here: Adlik Antelope Release (V0.1.0).
- Release management:
- Open discussion
05/19
- Zoom meeting:TSC_20200519.mp4
Roll Call
Company | Attendee | |
TSC members | ZTE | Tao Liu, Shiying Jin, Liya Yuan, Chengcan Wang |
China Mobile | ||
China Unicom | Tengfei Liu | |
ICT,CAS | Kang Li | |
Other attendees |
Status of open action items
- Action/ Further study on possible solution for mapping, procedure to apply Adlik in ORAN. Propose a CR for ORAN standardization.
- Will discuss it tomorrow afternoon.
- Action/ Further study on possible solution for mapping, procedure to apply Adlik in ORAN. Propose a CR for ORAN standardization.
Work report and plans
- Release management:
- The first release is expected to be published on June 15.
- Model optimizer:
- A new branch has been created on Github, code and documentation are both ready.
- Related documentation will be posted on Zhihu, and a video introduction will be delivered next month.
- Serving engine:
- Interfaces for getting the model online/offline are completed.
- Action/ @Tao Liu for documentation on interface description.
- Compiling toolchain for ARM architecture.
- Support for auto optimization for parameters.
- Test for all the supported environment.
- Collabration with AIIA benchmark test for Inference frameworks.
- Action/ @Liya Yuan to contact with AIIA open source group to find out the requirements and solutions.
- Colleagues from China Unicom are added as committers.
- Action/ @Tao Liu to prepare for online video introdution to using Adlik.
- Interfaces for getting the model online/offline are completed.
- Release management:
- Open discussion
- A WeChat group is established for community communication.
04/21
- Zoom meeting:TSC_20200421.mp4
Roll Call
Company
Attendee
TSC members
ZTE
Tao Liu, Shiying Jin, Liya Yuan, Bintao Han, Chengcan Wang
China Mobile
Qi Sun, Xiang Li China Unicom
Tengfei Liu
Other attendees
Status of open action items
- Action/ Further study on possible solution for mapping, procedure to apply Adlik in ORAN.
- Come up with a solution on next TSC meeting.
- Action/ Further study on possible solution for mapping, procedure to apply Adlik in ORAN.
- Follow up on Adlik+ORAN discussion
- Presentation on integrating model compiling(which can be done by Adlik) in ML workflow in ORAN- by Bingtao Han
- Before deployment, a model needs to go through the model optimization and compiling pipeline.
- Action/ Propose a CR for ORAN standardization.
- Discussion on ORAN previous proposal for model deployment - by Qi Sun
- Three possible solutions, mapping to the cloud, edge and device solutions of Adlik.
- Use case for release C need to be further discussed.
- Presentation on integrating model compiling(which can be done by Adlik) in ML workflow in ORAN- by Bingtao Han
Work report and plans
- Model optimizer:
- Coding and testing for quantilization and pruning are almost done, document in progress. Code will be pushed to github in two weeks. Will implement more algorithms afterwards.
- Serving engine: Performance test for TF lite and tensorflow 2.1 runtime.
- In progress: 1) Compiler for lite; 2) Some new features, e.g. interfaces for model onboarding.
- Plan to test Adlik on ARM.
- Model optimizer:
- Open discussion
04/08
Roll Call
Company
Attendee
TSC members
ZTE
Tao Liu, Shiying Jin, Liya Yuan, Bintao Han, Wei Meng
China Mobile
Qi Sun, Xiang Li China Unicom
Tengfei Liu, Ao Li
Other attendees
Status of open action items
- Invited presentation from ORAN - Qi Sun
- Introduced projects in ORAN B release https://wiki.o-ran-sc.org/pages/viewpage.action?pageId=1179662.
- Introduced ML flow involved in traffic steering use case.
- Introduction to Adlik and possible solution of integration in ORAN open source
- Adlik can be used to optimize ML models before deploying to RIC platform.
Work report and plans
- 2 features were merged in master: Support for TF lite runtime and ML runtime.
- Updated data of ResNet50 benchmark test.
- Open discussion
- To deploy ML/DL models in RIC platform, the following need to be taken into consideration:
- Platform expansion to support resource allocation
- Generic xAPP that supports interaction with other xAPP
- Will further discuss about proposing a new use case in ORAN Release C. A demo for the use case is expected to be delivered based on ORAN release B.
- Action/ Further study on possible solution for mapping, procedure to apply Adlik in ORAN.
- To deploy ML/DL models in RIC platform, the following need to be taken into consideration:
03/24
Roll Call
Company
Attendee
TSC members
ZTE
Tao Liu, Shiying Jin, Liya Yuan
China Mobile
China Unicom
Ao Li, Tengfei Liu
Other attendees
Status of open action items
Action/ GitHub documentation for releases.
Follow up on Adlik+MEC discussion
The pull request of Benchmark code is on Github.
Work report and plans
- Benchmark test.
- New runtime supporting ML algorithms.
- Pruning is 80% finished, will be pushed to Optimizer repo.
- Open discussion
- Questions from Tengfei Liu:
- Difference between Adlik and other inference framework
- Adlik is product driven and focus more on quick deployment of models in production environment, which enables heterogeneous computing better model scheduling, less resource consumption.
- What can we do?
- Provide your requirements derived from your practices in concrete cases.
- Use it in your projects and do techinical verification.
- Difference between Adlik and other inference framework
- Questions from Tengfei Liu:
03/10
Roll Call
Company
Attendee
TSC members
ZTE
Shiying Jin, Liya Yuan
China Mobile
China Unicom
Ao Li, Tengfei Liu
Other attendees
Status of open action items
Action/ Article about heterogeneous computing in deep learning inference- Published at https://www.infoq.cn/article/eg4KWZd1UoFwjSsUzfgt
Action/ GitHub documentation for releases
- Will be updated soon.
Follow up on Adlik+MEC discussion
Benchmark code in progress.
- Ao Li from China Unicom presented benchmark-test China Unicom.pptx, discussed possible scenarios, testing metrics and use cases.
Work report and plans
- developing features about support for tensorflow lite runtime, support for ML models.
02/25
Roll Call
Company
Attendee
TSC members
ZTE
Tao Liu, Shiying Jin, Liya Yuan
China Mobile
China Unicom
Tengfei Liu, Ao Li
Other attendees
Status of open action items
Action/ Usability and inference performance related issues to be created on Github.Benchmark feature has been created as an issue.
Action/ Article about heterogeneous computing in deep learning inference
A draft version will be delivered before this weekend.
Action/ GitHub documentation for releases
Under discussion.
Action/ Enable DCO on Github
Follow up on Adlik+MEC discussion
Benchmark Test presented by Tao Liu benchmarkTest-cn.pptx,about the procedure, metrics, environment of the performance test. Code to be expected on github by next TSC meeting.
Models like MobileNet, Inception V3 can be added as new test models.
Metrics like latency can be added as new metrics.
Work report and plans
Shiying Jin: planning support for machine learning models, enhanced interface for inference, etc.
02/11
- Roll Call
- ZTE: Tao Liu, Shiying Jin, Liya Yuan
Status of open action items
Action/ Further discussion on ingration of Adlik in MEC. ----- Discussion materials will be provided and discussed via emails first.Action/ Documentation for detailed information about how to use the compiler. ----- Will be included as a new feature.- Work report and plans
- Taoliu: Discussed with China Unicom and concluded some directions to work on: a. usability(ease the use of Adlik and provide automated optimzation of parameters); b. inference performance( testbed, standard testing including model, framework and metrics). Corresponding issues will be created on Github.
- Shiying Jin: planning RSE(Realtime smart engine) that supports the management of machine learning models.
- Liya Yuan: Since several meetups and outreach activities are yet to come, detailed document need to be prepared in advance.
12/17
Roll Call
Company
Attendee
TSC members
ZTE
Tao Liu, Shiying Jin, Liya Yuan
China Mobile
Qi Sun
China Unicom
Tengfei Liu
Other attendees
Adlik TSC chair election
TSC voted and approved Liya Yuan as Adlik TSC chair.
Status of open action items
Further discussion on ingration of Adlik in MEC. ----- Discussion materials will be provided and discussed via emails first.
Documentation for detailed information about how to use the compiler. ----- Will be included as a new feature.
Work report and plans
Roadmap is updated on Github.
FPGA compiler and runtime will be developed first.
Open Discussion
Call for more developers to contribute to Adlik, e.g. to enable support for more op.
12/03
Self introdution of TSC members and developers
Company
Attendee
TSC members
ZTE
Tao Liu, Shiying Jin, Liya Yuan
China Mobile
Qi Sun
China Unicom
Tengfei Liu, Ao Li
Other attendees
Vishnu Ram
Adlik code walkthrough
Introduction to the two sub projects, model compiler and model serving(Tao Liu and Shiying Jin).
Q: How to give input to the model compiler? A: It's shown in the simpleMNIST demo.
Q: I have to always use the name mnist.h5 and manually input the layers in this compile_model.py? A: Further documentation will show how to get these parameters and pass them to compiler.
Adlik work plans
New features in progress: support for ARM CPU and FPGA; support for quantilization(Tao Liu).
Open Discussion
Adlik intergration with MEC(Ao Li)
The interface requirements need further discussion.
Requirements for APIs can be written collaboratively with ITU-T FG ML5G.
Actions
Further discussion on ingration of Adlik in MEC.
Documentation for detailed information about how to use the compiler.