ICAT Project

Search

ICAT Collaboration Meeting - 27th March 2025

Attendance

Attendees:

  • Rolf Krahl
  • Louise Davies
  • Kirsty Syder
  • Marjolaine Bodin
  • Santhosh Anandarama
  • Viktor Bozhinov
  • Alex de Maria

Agenda

Site Updates

HZB

DAPHNE4NFDI annual meeting - HZB hosting. Interesting discussions but not directly ICAT related. Otherwise nothing else to report.

ESRF

Nothing new, progressing on technques. Working on including more processed data in the data portal.

Working on OSCARS project on sample metadata in coming weeks and months. Discussion with Rolf next week on this topic.

ISIS

Payara server upgrade to 6. Currently on staging. Out to production within the week hopefully.

DLS

Had DataGateway & ICAT server & lucene upgrade released. Working on visit restore release now

Component Updates

datagateway-download-api

Single visit restore via queueing functionality.

Rolf: IDS can sometimes perform badly when multiple restores at the same time. Add a parameter to limit the number of restores. Louise: there's some extra visit splitting functionality as well as DLS visits are very large

ICAT 7 schema changes

Rolf says he may have a student who can work on icat.server issues.

Rolf: STFC asked about Instrument startDate & endDate additions? Would be good if you could create a formal issue Louise: sure

AOB

icat.schema

Investigation -> Dataset -> Datafile.

More longer term experiments e.g. catalysis experiments, multiple hours. Lots of beamline measurements to observe sample changes. Want whole thing to be a Dataset, but might want to search for individual beamline measurements.

Proposal: Datasets within Datasets? Would have a lot of consequences

Louise: STFC facilities either only have 1 dataset (ISIS) or have datasets generally respresenting wrong things anyway (DLS - directories as datasets)

Alex: single dataset, up to user to filter measurements within the dataset. Ideally keep ICAT as simple as possible

Rolf: XAS measurement search, you might want to search an individual experiment as a measurement could be repeated many times within

Louise: complex, could have infinite nesting of datasets!

Rolf: maybe not, you have control of your ingestion pipeline

Alex: we have the opposite, we have many datasets that we want to group as one. Search is more of a problem but we think it's fine to e.g. search by technique etc. and rely on user to search files for specific measurements

Louise: we probably need time to think about this offline

Rolf: can discuss at next F2F?

Next F2F?

Louise: we'll have to discuss with with our GL

Kevin: yes, will need to think of when/who will host

Kevin: sometimes we tag these on to other events - does anyone have ideas for this?

Louise: how about we think about this offline with our institutions and discuss more concretely next time? maybe send out polls after that

Rolf: can't attend the next 2 collab meetings

Next meeting

24th April - week of Easter Monday

Rolf: exactly why I can't go!

Louise: well April is always hard, in between week before/after Easter & school holidays which may/may not overlap struggle to get everyone to attend anyway