Roadmap

Upon the release of ianvs, the roadmap would be as follows

  • AUG 2022: Release Another Use Case and Advanced Algorithm Paradigm - Non-structured lifelong learning paradigm in ianvs

  • SEP 2022: Release Another Use Case, Dataset, and Algorithm Paradigm - Another structured dataset and lifelong learning paradigm in ianvs

  • OCT 2022: Release Advanced Benchmark Presentation - shared space for story manager to present your work in public

  • NOV 2022: Release Advanced Algorithm Paradigm - Re-ID with Multi-edge Synergy Inference in ianvs

  • DEC 2022: Release Simulation Tools

  • JUN 2023: More datasets, algorithms, and test cases with ianvs

  • DEC 2023: Standards, coding events, and competitions with ianvs

Ianvs v0.1.0 release

1. Release the Ianvs distributed synergy AI benchmarking framework.

  1. Release test environment management and configuration.

  2. Release test case management and configuration.

  3. Release test story management and configuration.

  4. Release the open-source test case generation tool: Use hyperparameter enumeration to fill in one configuration file to generate multiple test cases.

2. Release the PCB-AoI public dataset.

Release the PCB-AoI public dataset, its corresponding preprocessing, and baseline algorithm projects. Ianvs is the first open-source site for that dataset.

3. Support two new paradigms in test environments and test cases.

  1. Test environments and test cases that support the single-task learning paradigm.

  2. Test environments and test cases that support the incremental learning paradigm.

4. Release PCB-AoI benchmark cases based on the two new paradigms.

  1. Release PCB-AoI benchmark cases based on single-task learning, including leaderboards and test reports.

  2. Release PCB-AoI benchmark cases based on incremental learning, including leaderboards and test reports.