ICAT Project

Search

ICAT Collaboration Meeting - 28th September 2023

Attendance

Attendees:

  • Patrick
  • Andy
  • Rolf
  • Louise
  • Viktor
  • Kirsty
  • Alan
  • Alex
  • Allan

Apologies:

Site Updates

ESRF:

  • Working on the MX use cases
    • Deployed for some months, with ongoing testing
    • Contact friendly users next week
    • In a better position that ispyb
    • Room for improvement, possibility to add features beyond ispyb
    • Rolf: Our MX group does not have ispyb, plans to use it, would be nice to use the ESRF methods out of the box
      • Private meeting to discuss? Will need to contact the group
    • ispyb meeting at the end of November
    • Performance was a worry but actually is not bad
  • Issues with downloading files of ~2GB via HTTP?
    • DLS have had people attempting ~TB, but expect these to fail
    • Rolf has had issues, but it was the clientside network (i.e. failed at home, succeeded at office)
      • Alex also has these difficulties from home
    • ESRF IT thinks it could be IDS config - could be a limit?
    • Louise to test on an ISIS file as that's 1 level storage
    • ESRF have GLOBUS, but majority of open data is not visible on GLOBUS via file permissions so is not suitable

HZB:

  • ICAT still offline, unknown when it will come up
  • Internal Gitlab is back online
  • Lots of upcoming project meetings
  • ICAT components pending release will probably not be until November
    • DLS using ICAT6 but are and can continue to use SNAPSHOTs

ALBA:

No attendees

Sirius:

  • Tried data ingest
  • Sample tracking meeting: perhaps try another week
    • Want ESRF to participate but Alex isn't available, clashes with ICALEPCS
    • Going to send another poll

ISIS:

No news

DLS:

Still concerns about performance in the DB from Payara6 change

  • Request duplication fix in DG
  • Update Oracle drivers to auto

Component Updates

icat.server

ids.server

authn.oidc & icat.oaipmh

DataGateway

icat-doi-api

DataHub

ICALEPCS Paper

No contact from ALBA, SESAME - will have to remove them from authorship if they can't be reached

Deadline Monday evening?

Architecture:

  • Need to address comments from Rolf: Patrick
  • Need to update final diagram: Patrick
  • Check for missing citatons: Patrick

Frontends:

  • DataGateway content needed: Louise
  • DataHub content needed: Alex

Extensions/APIs:

  • datagateway/common search api - add reference to this section (non accademic is fine, we can use the webpage): Viktor
  • Python icat: Rolf
  • ICAT+: Alex?
  • ICAT OAIPMH: Rolf
  • Sample tracking: Alex

Science use cases:

  • Cryo-EM needs content: Alex
  • MX needs content (50-100 parameters should be focus of use case): Alex

Sites:

  • ISIS needs content: Louise
  • ESRF needs figures: Andy
  • HZB needs content: Rolf
  • ALBA: ?
  • SESAME: ?
  • SIRIUS: Allan

Collaboration:

  • indico site from previous workshop: ROlf

Next steps:

  • Expand on containerisation: Rolf?

Conclusion

  • Needs expanding

AOB

E-logbooks meeting

  • Meeting went well, but need to define next steps soon
  • General idea is that the e-logbook will be treated as another ICAT component (in time)
  • MongDB has a problematic license... Rolf suspects the e-logbook use case is not compliant with the license
    • Derived from GPL, but if you derive from MongoDB you have to use their license
    • CoachDB as an alternative
    • Consensus seems to be that this is not apply to us as we will not be offering MongoDB functionality, we are just using it as a DB which is allowed
  • Test of model federation in DataGateway:
    • Could do this
    • Not planning on anytime soon
    • Would be nice to know if different versions of React can work together in practice

Other meetings

Next Collaboration Meeting

Clashes with International Data Week