Trusted AI - Basic Guidance for Framework Use

1 Basic Guidance

• “GitOps” approach for software engineering
  • Source Control
  • CI/CD
  • Testing!
• Python Centric Software Package Dependency Management
• Literate programming nbdev, Jupyter (vscode), Integrated Documentation, Automatic generation of python modules and code
• Data Centric AI Approach
• Experiment Management - DVC Experiment Management
• Model Management
  • MLFlow
  • DVC
  • Hugging Face Model Cards
  • Model Evaluation Frameworks and Workflows
• Integration of “Sane Defaults”
  • Example
• Licenses, Persistent Identifiers, Machine Readable Povenance, Vocabularies - OpenRAIL License - DOI for Datasets and Models - Hugging Face Model Cards
• AI Policy
  • Huggingface AI Policy Interim Report
• Threat Modeling Securing the Future of Artificial Intelligence and Machine Learning at Microsoft
  • Microsoft Failure Modes in Machine Learning
  • Threat Modeling AI/ML Systems and Dependencies