Usage

Commands

  • autograder init: generates a .config directory with a skeleton config.toml file.
  • autograder testall: runs tests defined in config.toml on all projects (any subdirectories not prefixed with a .)
  • autograder test DIRECTORIES: runs tests on given list of directories

Directory structure

The script looks for .config subdirectory, and will attempt to grade any subdirectories not prefixed with a .

working_directory
├── .config
    ├── config.toml
    ├── {necessary files}
├── {student_submissions}

Workflow

  1. Gather all student submissions in a common directory, such that each submission is a subdirectory.
  2. Run autograder init to generate a .config/ directory.
  3. Edit .config/config.toml as necessary to define environment and tests (see Configuration for more details.
  4. Use autograder testall to run defined tests against all projects.
  5. Results with be collected in the .results/ directory.