Skip to content

GitLab

  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • M MICADO-WISE
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 132
    • Issues 132
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 10
    • Merge requests 10
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • MICADO
  • MICADO-WISE
  • Merge requests
  • !95

Add OCA rules creation, mock backward chaining, and DM changes

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Hugo Buddelmeijer requested to merge hb/ocawheregroupby into standardcado Jun 12, 2020
  • Overview 5
  • Commits 98
  • Pipelines 51
  • Changes 166

This is initial code to create OCA rules automatically from the data lineage. This supersedes !92 (closed).

The goal is not so much to create the OCA rules, but to use the creation of OCA rules as a way to ensure we have designed the pipeline properly.

It contains some data model changes:

  • All templates now have INS.MODE, DPR.CATG, DPR.TECH and DPR.TYPE defined.
  • Persistence now has its own recipe. This is still preliminary, but is a good use-case for the OCA rules.
  • There are several 'Unpersisted' classes to remove persistence from the raw data.
  • There is now a distinction between Raw data and Sky. Sky inherits from Raw and is on-sky data.
  • The reduced images and catalog classes have been refactored, so they are easier to use in OCA rules.
  • The photometric and astrometric calibration is now done on fully reduced frames (that is, background subtraction and illumination correction is applied).
  • The backward chaining is now ad-hoc defined in augment_backward_chaining.py. At some point this should be added to the Data Model properly.

@verdoes can you look at the data model changes in particular? That is, micado.vodsl and associationmatrix.ditaa / .png.

Edited Jun 16, 2020 by Hugo Buddelmeijer
Assignee
Assign to
Reviewer
Request review from
Time tracking
Source branch: hb/ocawheregroupby