MLOps monitoring platform
More Information: MLOps monitoring platformThe MLOps platform is made to handle a large number of models to automate training, retraining and serving those models.
IML4E MLOps Framework
More Information: IML4E MLOps FrameworkThe IML4E framework aims to bring an end-to-end approach on working with ML in enterprises.
Adversarial Test Toolbox
More Information: Adversarial Test ToolboxThe Adversarial Test Toolbox enables an in-depth assessment of adversarial robustness of the target models.
MLOps Testing Methodology
More Information: MLOps Testing MethodologyA comprehensive framework that incorporates testing in all phases by combining classical software engineering with data science activities
MLOps Maturity Assessment Scheme
More Information: MLOps Maturity Assessment SchemeThe IML4E Maturity Assessment helps to examine the implementation of MLOps in an organization and make informed decisions about improvements.
Pipeline Probe
More Information: Pipeline ProbePipeline Probe is a novel, open-source tool designed for automated quality assessment of machine learning models within MLOps pipelines.
Data Quality Evaluation Tool
More Information: Data Quality Evaluation ToolThe data quality evaluation tool conducts comprehensive assessments on the provided data, generating a holistic evaluation of its overall quality.
Continuous Auditing Based Certification for MLOps
More Information: Continuous Auditing Based Certification for MLOpsTo meet the demanding requirements of MLOps IML4E has developed CABC for MLops.
ML-Py-Stevedore
More Information: ML-Py-StevedoreML-Py-Stevedore is a ML-framework agnostic wrapper class and generic API plus Podman/Colima/Docker build automation for Python ML models.
Autonomously Adaptive Experimentation-Driven Pipeline
More Information: Autonomously Adaptive Experimentation-Driven PipelineMLOps pipeline takes care of the ML model, including various tasks such as model training, deployment, and serving.
VALICY – Virtual Validation System
More Information: VALICY – Virtual Validation SystemVALICY is an AI based python framework that enables virtual validation for AI/ML (and also complex software) applications.
SAGED: Error Detector for Tabular Data
More Information: SAGED: Error Detector for Tabular DataSAGED is a tool to automatically identify the contaminated records in tabular data in a holistic manner.
Cost-effecient ML
More Information: Cost-effecient MLStudying and testing empirically different methods based on the literature review that would work especially for non-image data.
ML Metrics Typology & AI Ethics Metrics
More Information: ML Metrics Typology & AI Ethics MetricsA typology for categorizing metrics for ML systems, and an initial list of AI ethics metrics for each category.
Calibrated confidence estimator
More Information: Calibrated confidence estimatorThe confidence estimator is used to estimate the uncertainty in the predictions of the Basware distillation pipeline.
