Live Status\Incident History

May 6, 2023

Site Unreachable

Outage

Opened: May 6, 2023, 5:36 PM UTC

Duration: 9m 16s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    May 6, 2023, 5:36 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 6, 2023, 5:45 PM UTC

    Issue resolved on monitor recovery.

May 5, 2023

Site Unreachable

Outage

Opened: May 5, 2023, 9:14 AM UTC

Duration: 51s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)


  • Opened
    May 5, 2023, 9:14 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 5, 2023, 9:15 AM UTC

    Issue resolved on monitor recovery.

May 4, 2023

Site Unreachable

Outage

Opened: May 4, 2023, 4:42 PM UTC

Duration: 25s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    May 4, 2023, 4:42 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 4, 2023, 4:42 PM UTC

    Issue resolved on monitor recovery.

May 3, 2023

Site Unreachable

Outage

Opened: May 3, 2023, 12:52 AM UTC

Duration: 9m 13s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    May 3, 2023, 12:52 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 3, 2023, 1:01 AM UTC

    Issue resolved on monitor recovery.

May 2, 2023

Healthcheck Assertion Failed

Outage

Opened: May 2, 2023, 9:47 PM UTC

Duration: 10m 9s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    May 2, 2023, 9:47 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 2, 2023, 9:58 PM UTC

    Issue resolved on monitor recovery.

May 1, 2023

Site Unreachable

Outage

Opened: May 1, 2023, 7:32 AM UTC

Duration: 9m 7s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    May 1, 2023, 7:32 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 1, 2023, 7:41 AM UTC

    Issue resolved on monitor recovery.

April 30, 2023

Site Unreachable

Outage

Opened: Apr 30, 2023, 7:17 PM UTC

Duration: 50s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)


  • Opened
    Apr 30, 2023, 7:17 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 30, 2023, 7:18 PM UTC

    Issue resolved on monitor recovery.

April 27, 2023

Site Unreachable

Outage

Opened: Apr 27, 2023, 8:12 AM UTC

Duration: 8m 42s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Apr 27, 2023, 8:12 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 27, 2023, 8:21 AM UTC

    Issue resolved on monitor recovery.

April 24, 2023

Site Unreachable

Outage

Opened: Apr 24, 2023, 8:16 PM UTC

Duration: 9m 23s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Apr 24, 2023, 8:16 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 24, 2023, 8:26 PM UTC

    Issue resolved on monitor recovery.

April 21, 2023

Healthcheck Assertion Failed

Outage

Opened: Apr 21, 2023, 4:25 AM UTC

Duration: 10m 35s

Affected services:MGnify Genome Search API (powered by Sourmash)


  • Opened
    Apr 21, 2023, 4:25 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 21, 2023, 4:36 AM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: Apr 21, 2023, 4:09 AM UTC

Duration: 19m 40s

Affected services:MGnify API


  • Opened
    Apr 21, 2023, 4:09 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 21, 2023, 4:29 AM UTC

    Issue resolved on monitor recovery.

April 19, 2023

Healthcheck Assertion Failed

Outage

Opened: Apr 19, 2023, 5:47 AM UTC

Duration: 10m 28s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Apr 19, 2023, 5:47 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 19, 2023, 5:58 AM UTC

    Issue resolved on monitor recovery.

April 18, 2023

Healthcheck Assertion Failed

Outage

Opened: Apr 18, 2023, 11:39 AM UTC

Duration: 9m 43s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Apr 18, 2023, 11:39 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 18, 2023, 11:49 AM UTC

    Issue resolved on monitor recovery.

April 12, 2023

Site Unreachable

Outage

Opened: Apr 12, 2023, 2:08 PM UTC

Duration: 8m 56s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Apr 12, 2023, 2:08 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 12, 2023, 2:17 PM UTC

    Issue resolved on monitor recovery.

April 8, 2023

Healthcheck Assertion Failed

Outage

Opened: Apr 8, 2023, 2:10 AM UTC

Duration: 1h 28m 40s

Affected services:MGnify Genome Search API (powered by COBS)


  • Opened
    Apr 8, 2023, 2:10 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:39 AM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: Apr 8, 2023, 1:57 AM UTC

Duration: 39m 58s

Affected services:MGnify Genome Search API (powered by Sourmash)


  • Opened
    Apr 8, 2023, 1:57 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 8, 2023, 2:07 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 2:16 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 2:22 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 2:37 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 2:47 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 2:57 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:07 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 3:22 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:27 AM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: Apr 8, 2023, 1:56 AM UTC

Duration: 1h 14m 40s

Affected services:MGnify API


  • Opened
    Apr 8, 2023, 1:56 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 8, 2023, 2:51 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 3:00 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:05 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 3:10 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:15 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 3:30 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:40 AM UTC

    Issue resolved on monitor recovery.

April 5, 2023

Site Unreachable

Outage

Opened: Apr 5, 2023, 8:49 PM UTC

Duration: 9m 11s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Apr 5, 2023, 8:49 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 5, 2023, 8:59 PM UTC

    Issue resolved on monitor recovery.

April 3, 2023

Healthcheck Assertion Failed

Outage

Opened: Apr 3, 2023, 7:42 AM UTC

Duration: 48h 15m 59s

Affected services:MGnify Genome Search API (powered by COBS)


  • Opened
    Apr 3, 2023, 7:42 AM UTC

    Issue opened on monitor failure.

  • Identified
    Apr 5, 2023, 7:52 AM UTC

    An expired SSL certificate caused the COBS-backed genome search to be unavailable.

  • Resolved
    Apr 5, 2023, 7:58 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Apr 3, 2023, 12:13 AM UTC

Duration: 2m 19s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)


  • Opened
    Apr 3, 2023, 12:13 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 3, 2023, 12:16 AM UTC

    Issue resolved on monitor recovery.

March 31, 2023

Site Unreachable

Outage

Opened: Mar 31, 2023, 9:16 PM UTC

Duration: 9m 10s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 31, 2023, 9:16 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 31, 2023, 9:25 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Mar 31, 2023, 7:03 PM UTC

Duration: 9m 28s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 31, 2023, 7:03 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 31, 2023, 7:12 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Mar 31, 2023, 2:41 AM UTC

Duration: 9m 15s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 31, 2023, 2:41 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 31, 2023, 2:50 AM UTC

    Issue resolved on monitor recovery.

March 29, 2023

Site Unreachable

Outage

Opened: Mar 29, 2023, 9:36 PM UTC

Duration: 5m 34s

Affected services:MGnify Genome Search API (powered by Sourmash)


  • Opened
    Mar 29, 2023, 9:36 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 29, 2023, 9:42 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Mar 29, 2023, 9:19 PM UTC

Duration: 29m 11s

Affected services:MGnify API


  • Opened
    Mar 29, 2023, 9:19 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 29, 2023, 9:29 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Mar 29, 2023, 9:44 PM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Mar 29, 2023, 10:03 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Mar 29, 2023, 4:40 PM UTC

Duration: 13m 49s

Affected services:MGnify Genome Search API (powered by COBS)


  • Opened
    Mar 29, 2023, 4:40 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 29, 2023, 4:54 PM UTC

    Issue resolved on monitor recovery.

March 28, 2023

Site Unreachable

Outage

Opened: Mar 28, 2023, 4:47 PM UTC

Duration: 9m 56s

Affected services:MGnify Genome Search API (powered by Sourmash)


  • Opened
    Mar 28, 2023, 4:47 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:57 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: Mar 28, 2023, 4:42 PM UTC

Duration: 14m 50s

Affected services:MGnify API


  • Opened
    Mar 28, 2023, 4:42 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:57 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Mar 28, 2023, 4:41 PM UTC

Duration: 14m 42s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 28, 2023, 4:41 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:56 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: Mar 28, 2023, 4:41 PM UTC

Duration: 15m 15s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Mar 28, 2023, 4:41 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:56 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: Mar 28, 2023, 4:40 PM UTC

Duration: 15m 5s

Affected services:MGnify Website


  • Opened
    Mar 28, 2023, 4:40 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:55 PM UTC

    Issue resolved on monitor recovery.

March 25, 2023

Site Unreachable

Outage

Opened: Mar 25, 2023, 5:05 PM UTC

Duration: 28s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 25, 2023, 5:05 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 25, 2023, 5:05 PM UTC

    Issue resolved on monitor recovery.

March 24, 2023

Healthcheck Assertion Failed

Outage

Opened: Mar 24, 2023, 7:07 AM UTC

Duration: 1m 53s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)


  • Opened
    Mar 24, 2023, 7:07 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 24, 2023, 7:09 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Mar 24, 2023, 7:22 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Mar 24, 2023, 7:23 AM UTC

    Issue resolved on monitor recovery.

March 23, 2023

Site Unreachable

Outage

Opened: Mar 23, 2023, 8:57 AM UTC

Duration: 25s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 23, 2023, 8:57 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 23, 2023, 8:57 AM UTC

    Issue resolved on monitor recovery.

March 22, 2023

Healthcheck Assertion Failed

Outage

Opened: Mar 22, 2023, 8:35 PM UTC

Duration: 10m 20s

Affected services:MGnify Genome Search API (powered by Sourmash)


  • Opened
    Mar 22, 2023, 8:35 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 22, 2023, 8:46 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: Mar 22, 2023, 8:31 PM UTC

Duration: 14m 43s

Affected services:MGnify API


  • Opened
    Mar 22, 2023, 8:31 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 22, 2023, 8:46 PM UTC

    Issue resolved on monitor recovery.

March 20, 2023

Site Unreachable

Outage

Opened: Mar 20, 2023, 9:45 PM UTC

Duration: 27s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 20, 2023, 9:45 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 20, 2023, 9:46 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: Mar 20, 2023, 7:09 PM UTC

Duration: 2m 26s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)


  • Opened
    Mar 20, 2023, 7:09 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 20, 2023, 7:11 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Mar 20, 2023, 9:43 AM UTC

Duration: 8m 55s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 20, 2023, 9:43 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 20, 2023, 9:52 AM UTC

    Issue resolved on monitor recovery.

March 19, 2023

Site Unreachable

Outage

Opened: Mar 19, 2023, 3:35 AM UTC

Duration: 8m 57s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 19, 2023, 3:35 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 19, 2023, 3:44 AM UTC

    Issue resolved on monitor recovery.

March 17, 2023

Site Unreachable

Outage

Opened: Mar 17, 2023, 11:54 AM UTC

Duration: 8m 8s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Mar 17, 2023, 11:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 17, 2023, 12:02 PM UTC

    Issue resolved on monitor recovery.

March 16, 2023

Site Unreachable

Outage

Opened: Mar 16, 2023, 7:21 PM UTC

Duration: 28s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 16, 2023, 7:21 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 16, 2023, 7:21 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Mar 16, 2023, 4:09 PM UTC

Duration: 9m 37s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 16, 2023, 4:09 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 16, 2023, 4:19 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed

Outage

Opened: Mar 16, 2023, 10:03 AM UTC

Duration: 2m 45s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)


  • Opened
    Mar 16, 2023, 10:03 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 16, 2023, 10:05 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Mar 16, 2023, 8:24 AM UTC

Duration: 27s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 16, 2023, 8:24 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 16, 2023, 8:24 AM UTC

    Issue resolved on monitor recovery.

March 14, 2023

Site Unreachable

Outage

Opened: Mar 14, 2023, 2:59 PM UTC

Duration: 9m 34s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 14, 2023, 2:59 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 14, 2023, 3:08 PM UTC

    Issue resolved on monitor recovery.

March 12, 2023

Site Unreachable

Outage

Opened: Mar 12, 2023, 3:50 AM UTC

Duration: 26s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 12, 2023, 3:50 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 12, 2023, 3:50 AM UTC

    Issue resolved on monitor recovery.

March 11, 2023

Site Unreachable

Outage

Opened: Mar 11, 2023, 5:00 AM UTC

Duration: 14m 12s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Mar 11, 2023, 5:00 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 11, 2023, 5:14 AM UTC

    Issue resolved on monitor recovery.

March 10, 2023

Site Unreachable

Outage

Opened: Mar 10, 2023, 8:48 AM UTC

Duration: 7h 22m 10s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 10, 2023, 8:48 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 10, 2023, 4:10 PM UTC

    Issue resolved on monitor recovery.

March 9, 2023

Protein database sequence search unavailable

Outage

Opened: Mar 9, 2023, 10:09 PM UTC

Duration: 19h 6m 46s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Investigating
    Mar 9, 2023, 10:07 PM UTC

    The PHMMER-backed MGnify sequence search over the MGnify protein database is currently unavailable. We are currently investigating the cause of this.

  • Resolved
    Mar 10, 2023, 5:16 PM UTC

    A configuration issue with the infrastructure caused the outage. This was corrected, and the service is operational. Apologies for the issues this may have caused.

Site Unreachable

Outage

Opened: Mar 9, 2023, 12:08 PM UTC

Duration: 8m 54s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Mar 9, 2023, 12:08 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 9, 2023, 12:16 PM UTC

    Issue resolved on monitor recovery.

March 8, 2023

Healthcheck Assertion Failed

Outage

Opened: Mar 8, 2023, 6:54 PM UTC

Duration: 10m 17s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Mar 8, 2023, 6:54 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 8, 2023, 7:04 PM UTC

    Issue resolved on monitor recovery.

March 5, 2023

Site Unreachable

Outage

Opened: Mar 5, 2023, 7:21 PM UTC

Duration: 27s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Mar 5, 2023, 7:21 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 5, 2023, 7:22 PM UTC

    Issue resolved on monitor recovery.

March 1, 2023

Site Unreachable

Outage

Opened: Mar 1, 2023, 5:10 AM UTC

Duration: 35s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Mar 1, 2023, 5:10 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 1, 2023, 5:10 AM UTC

    Issue resolved on monitor recovery.

February 27, 2023

Site Unreachable

Outage

Opened: Feb 27, 2023, 9:18 AM UTC

Duration: 9m 5s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Feb 27, 2023, 9:18 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 27, 2023, 9:27 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Feb 27, 2023, 5:13 AM UTC

Duration: 36s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Feb 27, 2023, 5:13 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 27, 2023, 5:13 AM UTC

    Issue resolved on monitor recovery.

February 26, 2023

Site Unreachable

Outage

Opened: Feb 26, 2023, 3:31 AM UTC

Duration: 26s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Feb 26, 2023, 3:31 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 26, 2023, 3:32 AM UTC

    Issue resolved on monitor recovery.

February 24, 2023

Site Unreachable

Outage

Opened: Feb 24, 2023, 5:42 PM UTC

Duration: 9m 34s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Feb 24, 2023, 5:42 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 24, 2023, 5:51 PM UTC

    Issue resolved on monitor recovery.

February 23, 2023

Site Unreachable

Outage

Opened: Feb 23, 2023, 5:16 PM UTC

Duration: 2m 43s

Affected services:MGnify Notebooks Server (EMBL ShinyProxy host)


  • Opened
    Feb 23, 2023, 5:16 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 23, 2023, 5:17 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Feb 23, 2023, 5:25 PM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Feb 23, 2023, 5:27 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Feb 23, 2023, 10:11 AM UTC

Duration: 8m 56s

Affected services:MGnify Sequence Search (powered by HMMER)


  • Opened
    Feb 23, 2023, 10:11 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 23, 2023, 10:20 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable

Outage

Opened: Feb 23, 2023, 3:54 AM UTC

Duration: 9m 14s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Feb 23, 2023, 3:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 23, 2023, 4:03 AM UTC

    Issue resolved on monitor recovery.

February 22, 2023

Site Unreachable

Outage

Opened: Feb 22, 2023, 3:48 AM UTC

Duration: 9m 30s

Affected services:MGnify Text Search (powered by EBI Search)


  • Opened
    Feb 22, 2023, 3:48 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 22, 2023, 3:57 AM UTC

    Issue resolved on monitor recovery.

February 6, 2023

Sourmash Genome Search - results intermittently unavailable

Degraded Performance

Opened: Feb 6, 2023, 11:20 AM UTC

Duration: 8h 33m 52s

Affected services:MGnify Genome Search API (powered by Sourmash)


  • Identified
    Feb 6, 2023, 11:18 AM UTC

    The Sourmash-based Genome Search has been intermittently returning 500 server errors when viewing search results. The issue has been identified and a fix is being implemented. In the meantime, users can refresh the results page to see their search results.

  • Resolved
    Feb 6, 2023, 7:54 PM UTC

December 15, 2022

Sourmash search temporarily unavailable

Maintenance

Posted: Dec 15, 2022, 3:33 PM UTC


  • Identified
    Dec 15, 2022, 3:31 PM UTC

    The sourmash-backed genome search is temporarily unavailable, whilst we migrate the filesystem used for that service. We apologise for the loss of functionality.

  • Resolved
    Jan 12, 2023, 3:00 PM UTC

December 12, 2022

Instabilities across the service

Degraded Performance

Opened: Dec 12, 2022, 5:41 PM UTC

Duration: 71h 2m 25s


  • Monitoring
    Dec 12, 2022, 5:32 PM UTC

    Multiple parts of the MGnify service are experiencing instabilities currently. We believe this is due to an ongoing migration in the filesystems used by the servers.

  • Resolved
    Dec 15, 2022, 4:44 PM UTC

    The filesystem migration for the core MGnify services is now complete.

October 25, 2022

Sourmash Genome Search - API change

Maintenance

Posted: Oct 25, 2022, 11:33 AM UTC


  • Opened
    Oct 25, 2022, 11:33 AM UTC

    Incident opened on monitor failure.

  • Resolved
    Oct 25, 2022, 11:56 AM UTC

    This incident did not involve any actual downtime. The API options for Sourmash search have changed, to support searching multiple catalogues.

October 21, 2022

EBI Search timeouts

Degraded Performance

Opened: Oct 21, 2022, 7:50 AM UTC

Duration: 14m 56s


  • Opened
    Oct 21, 2022, 7:50 AM UTC

    Incident opened on monitor failure.

  • Monitoring
    Oct 21, 2022, 7:57 AM UTC
  • Resolved
    Oct 21, 2022, 8:05 AM UTC

    Incident resolved on monitor recovery.

October 20, 2022

COBS Genome Search unavailable

Outage

Opened: Oct 20, 2022, 9:05 AM UTC

Duration: 57m 21s


  • Opened
    Oct 20, 2022, 9:05 AM UTC

    Incident opened on monitor failure.

  • Resolved
    Oct 20, 2022, 10:02 AM UTC

    This outage was caused by an expired SSL certificate that has now been renewed.