InterOpApr2022DM < IVOA

IVOA Web>WebPreferences>ProgramPrepVirtualApr2022>InterOpApr2022>InterOpApr2022DM (2022-04-28, LaurentMichel) (raw view)

EditAttach

---+ DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

*[[[InterOpApr2022][back to main programme page]]]*

---+++ *Interop Closed, see you next North Fall*

| *Schedule Summary* |||||||
| *Session* | *DateTime UTC* | *UTC-07:00* | *UTC-04:00* | *UTC+02:00* | *UTC+08:00* | *UTC+10:00* |
| ^ | ^ | _Victoria BC/Pasadena_ | _Washington DC_ | _Strasbourg_ | _Perth/Beijing_ | _Canberra_ |
| DM 1 | [[https://www.timeanddate.com/worldclock/fixedtime.html?msg=DM1&iso=20220427T1500&p1=1440&ah=1][Apr 27 15:00]] | Apr 27 08:00 | Apr 27 11:00 | Apr 27 17:00 | Apr 27 23:00 | Apr 28 01:00 |
| DM 2 | [[https://www.timeanddate.com/worldclock/fixedtime.html?msg=DM2&iso=20220428T0500&p1=1440&ah=1][Apr 28 05:00]] | Apr 27 22:00 | Apr 28 01:00 | Apr 28 07:00 | Apr 28 13:00 | Apr 28 15:00 |

---++++ Notes and session video recording are linked below each session schedule table.

---++ DM 1: Data Models

*Time: [[https://www.timeanddate.com/worldclock/fixedtime.html?msg=DM1&iso=20220427T1500&p1=1440&ah=1][Apr 27 15:00]] [session #10]*

| *Speaker* | *Title* | *Time* | *Material* |
| Paul Harrison | DM Tooling | 12 + 3 | <ul style="background-color: #ffffff;"> <li>[[%ATTACHURL%/VO-DML_TOOLS_Update_PAH.pdf][VO-DML_TOOLS_Update_PAH.pdf]]</li> </ul> |
| Mathieu Servillat | Last Step Provenance | 12 + 3 | <ul style="background-color: #ffffff;"> <li>[[%ATTACHURL%/2022-04-27_Last-step_provenance_IVOA.pdf][2022-04-27_Last-step_provenance_IVOA.pdf]]</li> </ul> |
| Paul Harrison | Observation Proposal DM | 12 + 3 | <ul style="background-color: #ffffff;"> <li>[[%ATTACHURL%/ProposalDM2-PAH.pdf][ProposalDM2-PAH.pdf]]</li> </ul> |
| Francois Bonnarel | Instrument Field of View DM and mapping in VOT | 12 + 3 | <ul style="background-color: #ffffff;"> <li>[[%ATTACHURL%/InstrumentFoV-DMMIVOT.pdf][InstrumentFoV-DM-MIVOT]]</li> </ul> |

Moderator: [[IVOA.LaurentMichel][Laurent]] , Notetaker: [[IVOA.JesusSalgado][Jesus]]

*notes: [[%ATTACHURL%/IVOA_Apr22_DM-365days.txt][etherpad notes]]* *([[https://yopad.eu/p/IVOA_Apr22_DM-365days][link to live notes]], should expire around end of April 2023)*

---++ DM 2 : VOTable Annotation

*Time:* *[[https://www.timeanddate.com/worldclock/fixedtime.html?msg=DM2&iso=20220428T0500&p1=1440&ah=1][Apr 28 05:00]] [session #13]*

| *Speaker* | *Title* | *Time* | *Material* |
| Laurent Michel | Annotation Syntax | 12+ 3 | [[%ATTACHURL%/2022-DMMapping-LockTown5.pdf][2022-DMMapping-LockTown5.pdf]] |
| Mireille Louys | Annotating TAP Responses on the Fly | 12 + 3 | [[%ATTACHURL%/InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf][InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf]] |
| Laurent Michel | Implementation Status, issues and Prospects | | [[%ATTACHURL%/2022-DMMappingAPI-LockTown5.pdf][2022-DMMappingAPI-LockTown5.pdf]] |
| | | | |

Moderator: [[IVOA.FrancoisBonnarel][Francois]], Notetaker: [[IVOA.JesusSalgado][Jesus]]

*notes: [[%ATTACHURL%/IVOA_Apr22_DM-365days.txt][etherpad notes]]* *([[https://yopad.eu/p/IVOA_Apr22_DM-365days][link to live notes]], should expire around end of April 2023)*
---++ <strong>Abstracts<br /></strong>

*DM Tooling (Paul Harrison)*

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in <a target="_blank" href="https://github.com/ivoa/vo-dml" title="https://github.com/ivoa/vo-dml">https://github.com/ivoa/vo-dml</a>

*Last Step Provenance (Mathieu Servillat)*

<div id="_mcePaste">We propose a simplified structure to describe the immediate provenance of an entity as a single record, based on the [[https://www.ivoa.net/documents/ProvenanceDM][IVOA Provenance Data Model]], in order to facilitate its use and adoption.</div> <div id="_mcePaste">We thus define a flat list of attributes to describe the last activity that led to the generation of an entity, in the particular case of digital dataset generation.</div>

The note can be accessed here : [[https://wiki.ivoa.net/internal/IVOA/InterOpApr2022DM/2022-04-14_IVOA_Note___Last_step_provenance.pdf][2022-04-14_IVOA_Note___Last_step_provenance.pdf<span style="background-color: transparent;">]]</span>

*Observation Proposal DM (Paul Harrison)*

A data model for creating and managing observing proposals is being created in <a target="_blank" href="https://github.com/ivoa/ProposalDM" title="proposal data model">https://github.com/ivoa/ProposalDM</a>. The current status and future plans will be presented. It should be noted that there will be a [[InterOpApr2022Hack][hack-a-thon session]] for those wishing to learn more and be able to contribute to the model.

*Instrument Field of View DM and mapping in VOT (François Bonnarel)*

The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.<br />The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.<br />We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.

*Annotation Syntax (Laurent Michel)*

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

*Annotating TAP Response on the Fly (Mireille Louys)*

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

*Annotation: Implementation Status, Issues and Prospects (Laurent Michel)*

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon [[https://mdbook.obspm.fr/s/GqRszivT9#][topic]]

*[[[InterOpApr2022][back to main programme page]]]*

-- IVOA.LaurentMichel - 2022-04-21

<!--
      * Set ALLOWTOPICRENAME = IVOA.TWikiAdminGroup
-->

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
pdf	2022-04-14_IVOA_Note___Last_step_provenance.pdf	r1	manage	371.2 K	2022-04-25 - 15:16	MathieuServillat	2022-04-14 IVOA_Note___Last_step_provenance
pdf	2022-04-27_Last-step_provenance_IVOA.pdf	r1	manage	1962.4 K	2022-04-27 - 14:45	MathieuServillat
pdf	2022-DMMapping-LockTown5.pdf	r1	manage	2027.9 K	2022-04-28 - 04:12	LaurentMichel
pdf	2022-DMMappingAPI-LockTown5.pdf	r1	manage	626.8 K	2022-04-28 - 04:13	LaurentMichel	API proposal for processing annotated data
txt	IVOA_Apr22_DM-365days.txt	r1	manage	7.9 K	2022-04-28 - 13:07	LaurentMichel
pdf	InstrumentFoV-DMMIVOT.pdf	r1	manage	2001.6 K	2022-04-27 - 15:09	FrancoisBonnarel	Instrument Field of View DM and mapping in VOT
pdf	InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf	r1	manage	276.4 K	2022-04-28 - 08:33	MireilleLouys	Model annotation in TAP service using MIVOT mapping syntax
pdf	ModelAnnotationOnTheFlyInTap-Louys.pdf	r1	manage	276.4 K	2022-04-27 - 21:38	MireilleLouys	Model annotation in TAP service using MIVOT mapping syntax
pdf	ProposalDM2-PAH.pdf	r1	manage	2665.4 K	2022-04-27 - 13:07	PaulHarrison	Proposal DM Slides
pdf	VO-DML_TOOLS_Update_PAH.pdf	r1	manage	3989.1 K	2022-04-27 - 13:08	PaulHarrison	VO-DML Tooling update slides