MGnify (EBI Metagenomics) platform status

Support

Live Status\Incident History

September 15, 2023

Healthcheck Assertion Failed

Outage

Opened: Sep 15, 2023, 3:21 PM UTC

Duration: 1m 43s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)

  • Opened
    Sep 15, 2023, 3:21 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 15, 2023, 3:23 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 15, 2023, 10:02 AM UTC

Duration: 9m 25s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Sep 15, 2023, 10:02 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 15, 2023, 10:11 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 15, 2023, 2:03 AM UTC

Duration: 1m 33s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)

  • Opened
    Sep 15, 2023, 2:03 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 15, 2023, 2:04 AM UTC

    Issue resolved on monitor recovery.

September 14, 2023

Healthcheck Assertion Failed

Outage

Opened: Sep 14, 2023, 9:16 AM UTC

Duration: 22h 47m 14s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Sep 14, 2023, 9:16 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 15, 2023, 8:04 AM UTC

    Issue resolved on monitor recovery.

September 12, 2023

Site Unreachable

Outage

Opened: Sep 12, 2023, 11:10 PM UTC

Duration: 9m 48s

Affected services:MGnify API

  • Opened
    Sep 12, 2023, 11:10 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 11:19 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 12, 2023, 9:32 PM UTC

Duration: 1h 19m 8s

Affected services:MGnify MongoDB

  • Opened
    Sep 12, 2023, 9:32 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 9:42 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 9:47 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:06 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 10:19 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:40 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 10:45 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 11:14 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 12, 2023, 7:31 PM UTC

Duration: 1h 51m 24s

Affected services:MGnify API

  • Opened
    Sep 12, 2023, 7:31 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 7:40 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 7:45 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 8:54 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 8:59 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 9:32 PM UTC

    Issue resolved on monitor recovery.

MGnify API and website are slow/failing to respond

Degraded Performance

Opened: Sep 12, 2023, 2:37 PM UTC

Duration: 475h 4m 28s

Affected services:MGnify APIMGnify WebsiteMGnify Genome Search API (powered by COBS)MGnify Genome Search API (powered by Sourmash)MGnify Notebooks Server (EMBL ShinyProxy host)MGnify MongoDB

  • Investigating
    Sep 12, 2023, 2:37 PM UTC

    The MGnify web resource is under heavy load, and consequently experiencing intermittent unavailability due to the number of database queries being made. We are investigating the cause of the degraded performance.

  • Monitoring
    Sep 13, 2023, 2:05 PM UTC

    MGnify's API rate limits have been updated to help prevent individual clients from degrading the service performance. Users wishing to programmatically access MGnify should remember to: - use query filters wherever possible to minimise the size of their query - use the pagination controls provided by the MGnify API - use timeouts and handle rate limit exceptions returned by the API

  • Resolved
    Oct 2, 2023, 9:42 AM UTC

    Status changed to resolved.

Site Unreachable

Outage

Opened: Sep 12, 2023, 1:16 PM UTC

Duration: 3h 50m 19s

Affected services:MGnify MongoDB

  • Opened
    Sep 12, 2023, 1:16 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 1:30 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 1:54 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 2:15 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 2:24 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 2:47 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 3:02 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 3:15 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 3:26 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 3:41 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 4:14 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 4:35 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 4:45 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 5:05 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 5:09 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 5:48 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 6:37 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 6:48 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 7:21 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 7:49 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 8:04 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 8:28 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 12, 2023, 1:14 PM UTC

Duration: 4h 29m 1s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Sep 12, 2023, 1:14 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 1:28 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 2:21 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 2:36 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 3:20 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 3:39 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 3:59 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 4:12 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 4:37 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 4:56 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 5:21 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 5:56 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 6:14 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 6:56 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 7:32 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 8:06 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 8:50 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 9:06 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 9:10 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 9:28 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 9:53 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:17 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 10:32 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:51 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 12, 2023, 1:14 PM UTC

Duration: 2h 45m 32s

Affected services:MGnify API

  • Opened
    Sep 12, 2023, 1:14 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 1:19 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 1:54 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 2:37 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 3:11 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 3:37 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 3:46 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 4:10 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 4:19 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 4:39 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 5:14 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 5:28 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 5:33 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 5:52 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 6:08 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 6:22 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 12, 2023, 12:54 PM UTC

Duration: 4h 23m 51s

Affected services:MGnify Genome Search API (powered by Sourmash)

  • Opened
    Sep 12, 2023, 12:54 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 1:22 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 1:43 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 2:07 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 2:14 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 2:52 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 3:09 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 3:32 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 3:58 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 4:12 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 5:02 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 5:03 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 5:47 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 5:51 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 6:47 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 6:52 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 7:08 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 7:22 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 7:57 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 8:22 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 8:42 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 9:23 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 9:27 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 9:36 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 10:00 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:06 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 10:10 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:25 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 10:51 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 11:05 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 12, 2023, 10:49 AM UTC

Duration: 9m 27s

Affected services:MGnify Genome Search API (powered by Sourmash)

  • Opened
    Sep 12, 2023, 10:49 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:58 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 12, 2023, 10:47 AM UTC

Duration: 30s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Sep 12, 2023, 10:47 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:48 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 12, 2023, 10:29 AM UTC

Duration: 9m 19s

Affected services:MGnify API

  • Opened
    Sep 12, 2023, 10:29 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:38 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Sep 12, 2023, 10:20 AM UTC

Duration: 23m 58s

Affected services:MGnify MongoDB

  • Opened
    Sep 12, 2023, 10:20 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:29 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Sep 12, 2023, 10:44 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Sep 12, 2023, 10:59 AM UTC

    Issue resolved on monitor recovery.

September 4, 2023

MGnify - Sequence Search outage

Outage

Opened: Sep 4, 2023, 3:16 PM UTC

Duration: 22m 16s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Identified
    Sep 4, 2023, 3:16 PM UTC

    The service is currently down. We have identified the problem and we are working to resolve it.

  • Resolved
    Sep 4, 2023, 3:38 PM UTC

    The service is now operational.

August 30, 2023

Site Unreachable

Outage

Opened: Aug 30, 2023, 12:14 PM UTC

Duration: 8m 20s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Aug 30, 2023, 12:14 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 30, 2023, 12:23 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 30, 2023, 12:00 PM UTC

Duration: 1m 21s

Affected services:MGnify Website

  • Opened
    Aug 30, 2023, 12:00 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 30, 2023, 12:02 PM UTC

    Issue resolved on monitor recovery.

August 28, 2023

Site Unreachable

Outage

Opened: Aug 28, 2023, 2:47 PM UTC

Duration: 9m 10s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 28, 2023, 2:47 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 28, 2023, 2:56 PM UTC

    Issue resolved on monitor recovery.

August 24, 2023

Site Unreachable

Outage

Opened: Aug 24, 2023, 6:18 AM UTC

Duration: 9m 20s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 24, 2023, 6:18 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 24, 2023, 6:27 AM UTC

    Issue resolved on monitor recovery.

August 23, 2023

Healthcheck Assertion Failed

Outage

Opened: Aug 23, 2023, 3:46 PM UTC

Duration: 24m 53s

Affected services:MGnify Genome Search API (powered by Sourmash)

  • Opened
    Aug 23, 2023, 3:46 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 23, 2023, 4:11 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 23, 2023, 11:01 AM UTC

Duration: 9m 25s

Affected services:MGnify Genome Search API (powered by Sourmash)

  • Opened
    Aug 23, 2023, 11:01 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 23, 2023, 11:11 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 23, 2023, 10:05 AM UTC

Duration: 34m 40s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 23, 2023, 10:05 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 23, 2023, 10:10 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 23, 2023, 10:19 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 23, 2023, 10:34 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 23, 2023, 10:49 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 23, 2023, 11:04 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 23, 2023, 5:44 AM UTC

Duration: 9m 11s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    Aug 23, 2023, 5:44 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 23, 2023, 5:53 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 23, 2023, 4:20 AM UTC

Duration: 9m 54s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 23, 2023, 4:20 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 23, 2023, 4:30 AM UTC

    Issue resolved on monitor recovery.

August 22, 2023

Site Unreachable

Outage

Opened: Aug 22, 2023, 2:26 PM UTC

Duration: 28s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 22, 2023, 2:26 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 22, 2023, 2:26 PM UTC

    Issue resolved on monitor recovery.

August 21, 2023

Site Unreachable

Outage

Opened: Aug 21, 2023, 10:00 AM UTC

Duration: 20m 21s

Affected services:MGnify MongoDB

  • Opened
    Aug 21, 2023, 10:00 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 21, 2023, 10:09 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 21, 2023, 10:57 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 21, 2023, 11:09 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 21, 2023, 9:41 AM UTC

Duration: 9m 3s

Affected services:MGnify Genome Search API (powered by Sourmash)

  • Opened
    Aug 21, 2023, 9:41 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 21, 2023, 9:50 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 21, 2023, 9:35 AM UTC

Duration: 27m 22s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Aug 21, 2023, 9:35 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 21, 2023, 9:44 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 21, 2023, 10:19 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 21, 2023, 10:38 AM UTC

    Issue resolved on monitor recovery.

August 20, 2023

Site Unreachable

Outage

Opened: Aug 20, 2023, 12:56 AM UTC

Duration: 9m 55s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 20, 2023, 12:56 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 20, 2023, 1:06 AM UTC

    Issue resolved on monitor recovery.

August 19, 2023

Site Unreachable

Outage

Opened: Aug 19, 2023, 1:40 PM UTC

Duration: 3m 5s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)

  • Opened
    Aug 19, 2023, 1:40 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 19, 2023, 1:43 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 19, 2023, 12:05 AM UTC

Duration: 8m 40s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 19, 2023, 12:05 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 19, 2023, 12:14 AM UTC

    Issue resolved on monitor recovery.

August 18, 2023

Site Unreachable

Degraded Performance

Opened: Aug 18, 2023, 11:17 AM UTC

Duration: 57m 13s

Affected services:MGnify MongoDB

  • Opened
    Aug 18, 2023, 11:17 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 11:26 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 11:41 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 11:55 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 12:45 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 12:56 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 1:06 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 1:28 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 18, 2023, 10:13 AM UTC

Duration: 3m 1s

Affected services:MGnify MongoDB

  • Opened
    Aug 18, 2023, 10:13 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 10:16 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 18, 2023, 9:57 AM UTC

Duration: 1h 29m 40s

Affected services:MGnify API

  • Opened
    Aug 18, 2023, 9:57 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 10:12 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 11:01 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 11:13 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 11:15 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 11:45 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 12:28 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 12:43 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 12:58 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 1:17 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 18, 2023, 9:55 AM UTC

Duration: 23m 42s

Affected services:MGnify Website

  • Opened
    Aug 18, 2023, 9:55 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 10:05 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 10:30 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 10:44 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 18, 2023, 9:55 AM UTC

Duration: 23m 21s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 18, 2023, 9:55 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 10:05 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 10:30 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 10:43 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 18, 2023, 9:37 AM UTC

Duration: 52m 58s

Affected services:MGnify Genome Search API (powered by Sourmash)

  • Opened
    Aug 18, 2023, 9:37 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 9:46 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 10:32 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 10:46 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 11:07 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 11:31 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 12:02 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 12:06 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 18, 2023, 9:32 AM UTC

Duration: 1h 46m 59s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Aug 18, 2023, 9:32 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 9:46 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 10:15 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 10:30 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 10:40 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 11:14 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 11:33 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 12:06 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Aug 18, 2023, 12:36 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Aug 18, 2023, 12:46 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 18, 2023, 6:40 AM UTC

Duration: 5m 11s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Aug 18, 2023, 6:40 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 6:45 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 18, 2023, 4:29 AM UTC

Duration: 27s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Aug 18, 2023, 4:29 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 4:29 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 18, 2023, 12:54 AM UTC

Duration: 33s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Aug 18, 2023, 12:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 18, 2023, 12:55 AM UTC

    Issue resolved on monitor recovery.

August 17, 2023

Site Unreachable

Outage

Opened: Aug 17, 2023, 6:25 PM UTC

Duration: 9m 25s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Aug 17, 2023, 6:25 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 17, 2023, 6:34 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Aug 17, 2023, 8:35 AM UTC

Duration: 9m 42s

Affected services:MGnify Website

  • Opened
    Aug 17, 2023, 8:35 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 17, 2023, 8:45 AM UTC

    Issue resolved on monitor recovery.

August 14, 2023

Site Unreachable

Outage

Opened: Aug 14, 2023, 1:31 PM UTC

Duration: 9m 31s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 14, 2023, 1:31 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 14, 2023, 1:41 PM UTC

    Issue resolved on monitor recovery.

August 13, 2023

Site Unreachable

Outage

Opened: Aug 13, 2023, 10:39 AM UTC

Duration: 9m 13s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 13, 2023, 10:39 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 13, 2023, 10:48 AM UTC

    Issue resolved on monitor recovery.

August 10, 2023

Healthcheck Assertion Failed

Outage

Opened: Aug 10, 2023, 6:45 PM UTC

Duration: 2m 29s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)

  • Opened
    Aug 10, 2023, 6:45 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 10, 2023, 6:47 PM UTC

    Issue resolved on monitor recovery.

August 8, 2023

Site Unreachable

Outage

Opened: Aug 8, 2023, 7:45 AM UTC

Duration: 9m 15s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Aug 8, 2023, 7:45 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Aug 8, 2023, 7:54 AM UTC

    Issue resolved on monitor recovery.

July 25, 2023

Healthcheck Assertion Failed

Outage

Opened: Jul 25, 2023, 12:09 PM UTC

Duration: 10m 3s

Affected services:MGnify Genome Search API (powered by Sourmash)

  • Opened
    Jul 25, 2023, 12:09 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 25, 2023, 12:19 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jul 25, 2023, 11:36 AM UTC

Duration: 33m 1s

Affected services:MGnify MongoDB

  • Opened
    Jul 25, 2023, 11:36 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 25, 2023, 11:45 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jul 25, 2023, 12:00 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jul 25, 2023, 12:24 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jul 25, 2023, 11:35 AM UTC

Duration: 9m 26s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jul 25, 2023, 11:35 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 25, 2023, 11:45 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jul 25, 2023, 11:31 AM UTC

Duration: 47m 52s

Affected services:MGnify API

  • Opened
    Jul 25, 2023, 11:31 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 25, 2023, 11:45 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jul 25, 2023, 12:00 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jul 25, 2023, 12:34 PM UTC

    Issue resolved on monitor recovery.

July 15, 2023

Site Unreachable

Outage

Opened: Jul 15, 2023, 1:12 AM UTC

Duration: 9m 19s

Affected services:MGnify Website

  • Opened
    Jul 15, 2023, 1:12 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 15, 2023, 1:21 AM UTC

    Issue resolved on monitor recovery.

July 13, 2023

Site Unreachable

Outage

Opened: Jul 13, 2023, 9:33 PM UTC

Duration: 1m 26s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)

  • Opened
    Jul 13, 2023, 9:33 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 13, 2023, 9:34 PM UTC

    Issue resolved on monitor recovery.

July 11, 2023

Site Unreachable

Outage

Opened: Jul 11, 2023, 12:07 AM UTC

Duration: 33m 14s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Jul 11, 2023, 12:07 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 11, 2023, 12:11 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jul 11, 2023, 1:00 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jul 11, 2023, 1:11 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jul 11, 2023, 1:24 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jul 11, 2023, 1:42 AM UTC

    Issue resolved on monitor recovery.

July 7, 2023

Healthcheck Assertion Failed

Minor Outage

Opened: Jul 7, 2023, 9:33 AM UTC

Duration: 31h 32m 7s

Affected services:MGnify Genome Search API (powered by Sourmash)

  • Opened
    Jul 7, 2023, 9:33 AM UTC

    Issue opened on monitor failure.

  • Monitoring
    Jul 8, 2023, 5:01 PM UTC

    The sourmash-backed genome search became unavailable due to the queue manager process failing to restart properly. This has been resolved.

  • Resolved
    Jul 8, 2023, 5:05 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jul 7, 2023, 6:07 AM UTC

Duration: 1m 6s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    Jul 7, 2023, 6:07 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 7, 2023, 6:08 AM UTC

    Issue resolved on monitor recovery.

July 6, 2023

Site Unreachable

Outage

Opened: Jul 6, 2023, 9:41 AM UTC

Duration: 30s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)

  • Opened
    Jul 6, 2023, 9:41 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 6, 2023, 9:41 AM UTC

    Issue resolved on monitor recovery.

July 4, 2023

Site Unreachable

Outage

Opened: Jul 4, 2023, 8:15 AM UTC

Duration: 9m 29s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Jul 4, 2023, 8:15 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jul 4, 2023, 8:25 AM UTC

    Issue resolved on monitor recovery.

June 29, 2023

Site Unreachable

Outage

Opened: Jun 29, 2023, 1:47 PM UTC

Duration: 29s

Affected services:MGnify API

  • Opened
    Jun 29, 2023, 1:47 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 29, 2023, 1:48 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 29, 2023, 9:58 AM UTC

Duration: 9m 18s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 29, 2023, 9:58 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 29, 2023, 10:07 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 29, 2023, 12:59 AM UTC

Duration: 59s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 29, 2023, 12:59 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 29, 2023, 1:00 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 29, 2023, 12:13 AM UTC

Duration: 30s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Jun 29, 2023, 12:13 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 29, 2023, 12:13 AM UTC

    Issue resolved on monitor recovery.

June 28, 2023

Site Unreachable

Outage

Opened: Jun 28, 2023, 1:54 AM UTC

Duration: 8m 57s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 28, 2023, 1:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 28, 2023, 2:03 AM UTC

    Issue resolved on monitor recovery.

June 27, 2023

Site Unreachable

Outage

Opened: Jun 27, 2023, 10:28 PM UTC

Duration: 19m 36s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 27, 2023, 10:28 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 27, 2023, 10:28 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jun 27, 2023, 10:57 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jun 27, 2023, 11:16 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 27, 2023, 8:42 AM UTC

Duration: 1h 1m 28s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    Jun 27, 2023, 8:42 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 27, 2023, 8:45 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jun 27, 2023, 9:07 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jun 27, 2023, 9:21 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jun 27, 2023, 9:32 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jun 27, 2023, 9:56 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jun 27, 2023, 10:22 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jun 27, 2023, 10:42 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 27, 2023, 5:42 AM UTC

Duration: 8m 34s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    Jun 27, 2023, 5:42 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 27, 2023, 5:51 AM UTC

    Issue resolved on monitor recovery.

June 26, 2023

Site Unreachable

Outage

Opened: Jun 26, 2023, 10:03 PM UTC

Duration: 4m 47s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 26, 2023, 10:03 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 26, 2023, 10:03 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jun 26, 2023, 10:52 PM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jun 26, 2023, 10:56 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 26, 2023, 8:23 AM UTC

Duration: 39s

Affected services:MGnify API

  • Opened
    Jun 26, 2023, 8:23 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 26, 2023, 8:24 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 26, 2023, 12:36 AM UTC

Duration: 4m 14s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 26, 2023, 12:36 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 26, 2023, 12:40 AM UTC

    Issue resolved on monitor recovery.

June 25, 2023

Site Unreachable

Outage

Opened: Jun 25, 2023, 6:07 PM UTC

Duration: 9m 3s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 25, 2023, 6:07 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 25, 2023, 6:16 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 25, 2023, 4:35 PM UTC

Duration: 27s

Affected services:MGnify MongoDB

  • Opened
    Jun 25, 2023, 4:35 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 25, 2023, 4:35 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 25, 2023, 9:53 AM UTC

Duration: 40s

Affected services:MGnify MongoDB

  • Opened
    Jun 25, 2023, 9:53 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 25, 2023, 9:54 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 25, 2023, 7:33 AM UTC

Duration: 7m 56s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 25, 2023, 7:33 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 25, 2023, 7:41 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 25, 2023, 2:32 AM UTC

Duration: 9m 36s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Jun 25, 2023, 2:32 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 25, 2023, 2:42 AM UTC

    Issue resolved on monitor recovery.

June 24, 2023

Site Unreachable

Outage

Opened: Jun 24, 2023, 7:57 AM UTC

Duration: 5m 39s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 24, 2023, 7:57 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 24, 2023, 7:58 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Jun 24, 2023, 8:41 AM UTC

    Issue re-opened on monitor failure.

  • Resolved
    Jun 24, 2023, 8:46 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 24, 2023, 4:48 AM UTC

Duration: 30s

Affected services:MGnify MongoDB

  • Opened
    Jun 24, 2023, 4:48 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 24, 2023, 4:49 AM UTC

    Issue resolved on monitor recovery.

June 23, 2023

Site Unreachable

Outage

Opened: Jun 23, 2023, 9:55 PM UTC

Duration: 33s

Affected services:MGnify MongoDB

  • Opened
    Jun 23, 2023, 9:55 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 23, 2023, 9:55 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 23, 2023, 3:16 AM UTC

Duration: 9m 2s

Affected services:MGnify Genome Search API (powered by COBS)

  • Opened
    Jun 23, 2023, 3:16 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 23, 2023, 3:25 AM UTC

    Issue resolved on monitor recovery.

June 20, 2023

Site Unreachable

Outage

Opened: Jun 20, 2023, 6:24 AM UTC

Duration: 8m 36s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    Jun 20, 2023, 6:24 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 20, 2023, 6:33 AM UTC

    Issue resolved on monitor recovery.

June 19, 2023

Site Unreachable

Outage

Opened: Jun 19, 2023, 8:10 AM UTC

Duration: 9m 30s

Affected services:MGnify API

  • Opened
    Jun 19, 2023, 8:10 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 19, 2023, 8:20 AM UTC

    Issue resolved on monitor recovery.

June 17, 2023

Site Unreachable

Outage

Opened: Jun 17, 2023, 7:04 PM UTC

Duration: 9m 46s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Jun 17, 2023, 7:04 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 17, 2023, 7:14 PM UTC

    Issue resolved on monitor recovery.

June 16, 2023

Contig annotations for assemblies unavailable

Degraded Performance

Opened: Jun 16, 2023, 3:30 PM UTC

Duration: 194h 2m 57s

  • Opened
    Jun 16, 2023, 3:30 PM UTC

    Issue opened on monitor failure.

  • Identified
    Jun 16, 2023, 3:46 PM UTC

    The MongoDB cluster serving MGnify experienced instability overnight on 15–16 June, resulting in some uncommitted data. We are working to correct the missing data and fix the performance issues. This means assembly analyses (e.g. contig annotations) are currently not readable with the usual performance.

  • Resolved
    Jun 24, 2023, 5:33 PM UTC

    The MongoDB server was moved to a new storage system, and missing data were recovered.

June 15, 2023

Not all data are currently searchable

Missing Data

Opened: Jun 15, 2023, 10:16 AM UTC

Duration: 5665h 40m 29s

Affected services:MGnify Text Search (powered by EBI Search)

  • Identified
    Jun 15, 2023, 10:16 AM UTC

    Some datasets are missing from the index that MGnify provides to EBI Search. This means that not all Analyses are findable via the Text Search feature on MGnify. We are currently working to generate a complete search index. Missing datasets can also be found using the Browse section of the website or the API filters.

  • Resolved
    Feb 6, 2024, 11:56 AM UTC

    All public studies and analyses are now searchable.

June 13, 2023

Site Unreachable

Outage

Opened: Jun 13, 2023, 12:38 PM UTC

Duration: 53s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Jun 13, 2023, 12:38 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 13, 2023, 12:39 PM UTC

    Issue resolved on monitor recovery.

June 9, 2023

Site Unreachable

Outage

Opened: Jun 9, 2023, 4:35 AM UTC

Duration: 8m 56s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    Jun 9, 2023, 4:35 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 9, 2023, 4:44 AM UTC

    Issue resolved on monitor recovery.

June 6, 2023

Site Unreachable

Outage

Opened: Jun 6, 2023, 7:04 PM UTC

Duration: 9m 11s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    Jun 6, 2023, 7:04 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 6, 2023, 7:13 PM UTC

    Issue resolved on monitor recovery.

June 5, 2023

Site Unreachable

Outage

Opened: Jun 5, 2023, 1:54 PM UTC

Duration: 1m 20s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)

  • Opened
    Jun 5, 2023, 1:54 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 5, 2023, 1:55 PM UTC

    Issue resolved on monitor recovery.

May 31, 2023

Healthcheck Assertion Failed

Outage

Opened: May 31, 2023, 4:10 AM UTC

Duration: 9m 53s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    May 31, 2023, 4:10 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 31, 2023, 4:19 AM UTC

    Issue resolved on monitor recovery.

May 30, 2023

Healthcheck Assertion Failed

Outage

Opened: May 30, 2023, 9:19 PM UTC

Duration: 14m 44s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    May 30, 2023, 9:19 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 30, 2023, 9:29 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    May 30, 2023, 9:59 PM UTC

    Incident re-opened on monitor failure.

  • Resolved
    May 30, 2023, 10:04 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: May 30, 2023, 7:14 PM UTC

Duration: 10m 20s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    May 30, 2023, 7:14 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 30, 2023, 7:24 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: May 30, 2023, 9:24 AM UTC

Duration: 15m 9s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    May 30, 2023, 9:24 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 30, 2023, 9:34 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    May 30, 2023, 10:04 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    May 30, 2023, 10:09 AM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: May 30, 2023, 5:54 AM UTC

Duration: 10m 4s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    May 30, 2023, 5:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 30, 2023, 6:04 AM UTC

    Issue resolved on monitor recovery.

May 29, 2023

Healthcheck Assertion Failed

Outage

Opened: May 29, 2023, 10:49 PM UTC

Duration: 14m 36s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    May 29, 2023, 10:49 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 29, 2023, 10:59 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    May 29, 2023, 11:44 PM UTC

    Incident re-opened on monitor failure.

  • Resolved
    May 29, 2023, 11:49 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: May 29, 2023, 8:19 PM UTC

Duration: 10m 10s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    May 29, 2023, 8:19 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 29, 2023, 8:29 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: May 29, 2023, 6:54 AM UTC

Duration: 10m 2s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    May 29, 2023, 6:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 29, 2023, 7:04 AM UTC

    Issue resolved on monitor recovery.

May 20, 2023

Site Unreachable

Outage

Opened: May 20, 2023, 2:26 PM UTC

Duration: 9m 28s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    May 20, 2023, 2:26 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 20, 2023, 2:35 PM UTC

    Issue resolved on monitor recovery.

May 18, 2023

Site Unreachable

Outage

Opened: May 18, 2023, 6:33 PM UTC

Duration: 9m 17s

Affected services:MGnify Text Search (powered by EBI Search)

  • Opened
    May 18, 2023, 6:33 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 18, 2023, 6:42 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: May 18, 2023, 2:30 PM UTC

Duration: 2h 22m 15s

Affected services:MGnify Sequence Search (powered by HMMER)

  • Opened
    May 18, 2023, 2:30 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 18, 2023, 4:52 PM UTC

    Issue resolved on monitor recovery.