Live Status\Incident History

June 20, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Jun 20, 2023, 6:24 AM UTC

Duration: 8min 36sec


  • Opened
    Jun 20, 2023, 6:24 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 20, 2023, 6:33 AM UTC

    Issue resolved on monitor recovery.

June 19, 2023

Site Unreachable / MGnify API

Outage

Opened: Jun 19, 2023, 8:10 AM UTC

Duration: 9min 30sec


  • Opened
    Jun 19, 2023, 8:10 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 19, 2023, 8:20 AM UTC

    Issue resolved on monitor recovery.

June 17, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Jun 17, 2023, 7:04 PM UTC

Duration: 9min 46sec


  • Opened
    Jun 17, 2023, 7:04 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 17, 2023, 7:14 PM UTC

    Issue resolved on monitor recovery.

June 16, 2023

Contig annotations for assemblies unavailable

Degraded Performance

Opened: Jun 16, 2023, 3:30 PM UTC

Duration: 194hrs 2min 57sec


  • Opened
    Jun 16, 2023, 3:30 PM UTC

    Issue opened on monitor failure.

  • Identified
    Jun 16, 2023, 3:46 PM UTC

    The MongoDB cluster serving MGnify experienced instability overnight on 15–16 June, resulting in some uncommitted data. We are working to correct the missing data and fix the performance issues. This means assembly analyses (e.g. contig annotations) are currently not readable with the usual performance.

  • Resolved
    Jun 24, 2023, 5:33 PM UTC

    The MongoDB server was moved to a new storage system, and missing data were recovered.

June 15, 2023

Not all data are currently searchable / MGnify Text Search (powered by EBI Search)

Missing Data

Opened: Jun 15, 2023, 10:16 AM UTC

Duration: 5665hrs 40min 29sec


  • Identified
    Jun 15, 2023, 10:16 AM UTC

    Some datasets are missing from the index that MGnify provides to EBI Search. This means that not all Analyses are findable via the Text Search feature on MGnify. We are currently working to generate a complete search index. Missing datasets can also be found using the Browse section of the website or the API filters.

  • Resolved
    Feb 6, 2024, 11:56 AM UTC

    All public studies and analyses are now searchable.

June 13, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Jun 13, 2023, 12:38 PM UTC

Duration: 53sec


  • Opened
    Jun 13, 2023, 12:38 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 13, 2023, 12:39 PM UTC

    Issue resolved on monitor recovery.

June 9, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Jun 9, 2023, 4:35 AM UTC

Duration: 8min 56sec


  • Opened
    Jun 9, 2023, 4:35 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 9, 2023, 4:44 AM UTC

    Issue resolved on monitor recovery.

June 6, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Jun 6, 2023, 7:04 PM UTC

Duration: 9min 11sec


  • Opened
    Jun 6, 2023, 7:04 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 6, 2023, 7:13 PM UTC

    Issue resolved on monitor recovery.

June 5, 2023

Site Unreachable / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: Jun 5, 2023, 1:54 PM UTC

Duration: 1min 20sec


  • Opened
    Jun 5, 2023, 1:54 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Jun 5, 2023, 1:55 PM UTC

    Issue resolved on monitor recovery.

May 31, 2023

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 31, 2023, 4:10 AM UTC

Duration: 9min 53sec


  • Opened
    May 31, 2023, 4:10 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 31, 2023, 4:19 AM UTC

    Issue resolved on monitor recovery.

May 30, 2023

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 30, 2023, 9:19 PM UTC

Duration: 14min 44sec


  • Opened
    May 30, 2023, 9:19 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 30, 2023, 9:29 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    May 30, 2023, 9:59 PM UTC

    Incident re-opened on monitor failure.

  • Resolved
    May 30, 2023, 10:04 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 30, 2023, 7:14 PM UTC

Duration: 10min 20sec


  • Opened
    May 30, 2023, 7:14 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 30, 2023, 7:24 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 30, 2023, 9:24 AM UTC

Duration: 15min 9sec


  • Opened
    May 30, 2023, 9:24 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 30, 2023, 9:34 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    May 30, 2023, 10:04 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    May 30, 2023, 10:09 AM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 30, 2023, 5:54 AM UTC

Duration: 10min 4sec


  • Opened
    May 30, 2023, 5:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 30, 2023, 6:04 AM UTC

    Issue resolved on monitor recovery.

May 29, 2023

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 29, 2023, 10:49 PM UTC

Duration: 14min 36sec


  • Opened
    May 29, 2023, 10:49 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 29, 2023, 10:59 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    May 29, 2023, 11:44 PM UTC

    Incident re-opened on monitor failure.

  • Resolved
    May 29, 2023, 11:49 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 29, 2023, 8:19 PM UTC

Duration: 10min 10sec


  • Opened
    May 29, 2023, 8:19 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 29, 2023, 8:29 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 29, 2023, 6:54 AM UTC

Duration: 10min 2sec


  • Opened
    May 29, 2023, 6:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 29, 2023, 7:04 AM UTC

    Issue resolved on monitor recovery.

May 20, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: May 20, 2023, 2:26 PM UTC

Duration: 9min 28sec


  • Opened
    May 20, 2023, 2:26 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 20, 2023, 2:35 PM UTC

    Issue resolved on monitor recovery.

May 18, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 18, 2023, 6:33 PM UTC

Duration: 9min 17sec


  • Opened
    May 18, 2023, 6:33 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 18, 2023, 6:42 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: May 18, 2023, 2:30 PM UTC

Duration: 2hrs 22min 15sec


  • Opened
    May 18, 2023, 2:30 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 18, 2023, 4:52 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: May 18, 2023, 11:59 AM UTC

Duration: 43min 17sec


  • Opened
    May 18, 2023, 11:59 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 18, 2023, 12:42 PM UTC

    Issue resolved on monitor recovery.

May 17, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 17, 2023, 7:50 AM UTC

Duration: 8min 47sec


  • Opened
    May 17, 2023, 7:50 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 17, 2023, 7:59 AM UTC

    Issue resolved on monitor recovery.

May 14, 2023

Site Unreachable / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: May 14, 2023, 2:37 AM UTC

Duration: 1min 16sec


  • Opened
    May 14, 2023, 2:37 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 14, 2023, 2:38 AM UTC

    Issue resolved on monitor recovery.

May 9, 2023

Site Unreachable / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: May 9, 2023, 8:06 PM UTC

Duration: 1min 27sec


  • Opened
    May 9, 2023, 8:06 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 9, 2023, 8:08 PM UTC

    Issue resolved on monitor recovery.

May 6, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: May 6, 2023, 7:04 PM UTC

Duration: 9min 40sec


  • Opened
    May 6, 2023, 7:04 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 6, 2023, 7:14 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: May 6, 2023, 5:36 PM UTC

Duration: 9min 16sec


  • Opened
    May 6, 2023, 5:36 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 6, 2023, 5:45 PM UTC

    Issue resolved on monitor recovery.

May 5, 2023

Site Unreachable / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: May 5, 2023, 9:14 AM UTC

Duration: 51sec


  • Opened
    May 5, 2023, 9:14 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 5, 2023, 9:15 AM UTC

    Issue resolved on monitor recovery.

May 4, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: May 4, 2023, 4:42 PM UTC

Duration: 25sec


  • Opened
    May 4, 2023, 4:42 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 4, 2023, 4:42 PM UTC

    Issue resolved on monitor recovery.

May 3, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: May 3, 2023, 12:52 AM UTC

Duration: 9min 13sec


  • Opened
    May 3, 2023, 12:52 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 3, 2023, 1:01 AM UTC

    Issue resolved on monitor recovery.

May 2, 2023

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 2, 2023, 9:47 PM UTC

Duration: 10min 9sec


  • Opened
    May 2, 2023, 9:47 PM UTC

    Issue opened on monitor failure.

  • Resolved
    May 2, 2023, 9:58 PM UTC

    Issue resolved on monitor recovery.

May 1, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: May 1, 2023, 7:32 AM UTC

Duration: 9min 7sec


  • Opened
    May 1, 2023, 7:32 AM UTC

    Issue opened on monitor failure.

  • Resolved
    May 1, 2023, 7:41 AM UTC

    Issue resolved on monitor recovery.

April 30, 2023

Site Unreachable / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: Apr 30, 2023, 7:17 PM UTC

Duration: 50sec


  • Opened
    Apr 30, 2023, 7:17 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 30, 2023, 7:18 PM UTC

    Issue resolved on monitor recovery.

April 27, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Apr 27, 2023, 8:12 AM UTC

Duration: 8min 42sec


  • Opened
    Apr 27, 2023, 8:12 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 27, 2023, 8:21 AM UTC

    Issue resolved on monitor recovery.

April 24, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Apr 24, 2023, 8:16 PM UTC

Duration: 9min 23sec


  • Opened
    Apr 24, 2023, 8:16 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 24, 2023, 8:26 PM UTC

    Issue resolved on monitor recovery.

April 21, 2023

Healthcheck Assertion Failed / MGnify Genome Search API (powered by Sourmash)

Outage

Opened: Apr 21, 2023, 4:25 AM UTC

Duration: 10min 35sec


  • Opened
    Apr 21, 2023, 4:25 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 21, 2023, 4:36 AM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify API

Outage

Opened: Apr 21, 2023, 4:09 AM UTC

Duration: 19min 40sec


  • Opened
    Apr 21, 2023, 4:09 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 21, 2023, 4:29 AM UTC

    Issue resolved on monitor recovery.

April 19, 2023

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: Apr 19, 2023, 5:47 AM UTC

Duration: 10min 28sec


  • Opened
    Apr 19, 2023, 5:47 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 19, 2023, 5:58 AM UTC

    Issue resolved on monitor recovery.

April 18, 2023

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: Apr 18, 2023, 11:39 AM UTC

Duration: 9min 43sec


  • Opened
    Apr 18, 2023, 11:39 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 18, 2023, 11:49 AM UTC

    Issue resolved on monitor recovery.

April 12, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Apr 12, 2023, 2:08 PM UTC

Duration: 8min 56sec


  • Opened
    Apr 12, 2023, 2:08 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 12, 2023, 2:17 PM UTC

    Issue resolved on monitor recovery.

April 8, 2023

Healthcheck Assertion Failed / MGnify Genome Search API (powered by COBS)

Outage

Opened: Apr 8, 2023, 2:10 AM UTC

Duration: 1hr 28min 40sec


  • Opened
    Apr 8, 2023, 2:10 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:39 AM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Genome Search API (powered by Sourmash)

Outage

Opened: Apr 8, 2023, 1:57 AM UTC

Duration: 39min 58sec


  • Opened
    Apr 8, 2023, 1:57 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 8, 2023, 2:07 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 2:16 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 2:22 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 2:37 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 2:47 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 2:57 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:07 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 3:22 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:27 AM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify API

Outage

Opened: Apr 8, 2023, 1:56 AM UTC

Duration: 1hr 14min 40sec


  • Opened
    Apr 8, 2023, 1:56 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 8, 2023, 2:51 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 3:00 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:05 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 3:10 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:15 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Apr 8, 2023, 3:30 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Apr 8, 2023, 3:40 AM UTC

    Issue resolved on monitor recovery.

April 5, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Apr 5, 2023, 8:49 PM UTC

Duration: 9min 11sec


  • Opened
    Apr 5, 2023, 8:49 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 5, 2023, 8:59 PM UTC

    Issue resolved on monitor recovery.

April 3, 2023

Healthcheck Assertion Failed / MGnify Genome Search API (powered by COBS)

Outage

Opened: Apr 3, 2023, 7:42 AM UTC

Duration: 48hrs 15min 59sec


  • Opened
    Apr 3, 2023, 7:42 AM UTC

    Issue opened on monitor failure.

  • Identified
    Apr 5, 2023, 7:52 AM UTC

    An expired SSL certificate caused the COBS-backed genome search to be unavailable.

  • Resolved
    Apr 5, 2023, 7:58 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: Apr 3, 2023, 12:13 AM UTC

Duration: 2min 19sec


  • Opened
    Apr 3, 2023, 12:13 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Apr 3, 2023, 12:16 AM UTC

    Issue resolved on monitor recovery.

March 31, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 31, 2023, 9:16 PM UTC

Duration: 9min 10sec


  • Opened
    Mar 31, 2023, 9:16 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 31, 2023, 9:25 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 31, 2023, 7:03 PM UTC

Duration: 9min 28sec


  • Opened
    Mar 31, 2023, 7:03 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 31, 2023, 7:12 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 31, 2023, 2:41 AM UTC

Duration: 9min 15sec


  • Opened
    Mar 31, 2023, 2:41 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 31, 2023, 2:50 AM UTC

    Issue resolved on monitor recovery.

March 29, 2023

Site Unreachable / MGnify Genome Search API (powered by Sourmash)

Outage

Opened: Mar 29, 2023, 9:36 PM UTC

Duration: 5min 34sec


  • Opened
    Mar 29, 2023, 9:36 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 29, 2023, 9:42 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify API

Outage

Opened: Mar 29, 2023, 9:19 PM UTC

Duration: 29min 11sec


  • Opened
    Mar 29, 2023, 9:19 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 29, 2023, 9:29 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Mar 29, 2023, 9:44 PM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Mar 29, 2023, 10:03 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Genome Search API (powered by COBS)

Outage

Opened: Mar 29, 2023, 4:40 PM UTC

Duration: 13min 49sec


  • Opened
    Mar 29, 2023, 4:40 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 29, 2023, 4:54 PM UTC

    Issue resolved on monitor recovery.

March 28, 2023

Site Unreachable / MGnify Genome Search API (powered by Sourmash)

Outage

Opened: Mar 28, 2023, 4:47 PM UTC

Duration: 9min 56sec


  • Opened
    Mar 28, 2023, 4:47 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:57 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify API

Outage

Opened: Mar 28, 2023, 4:42 PM UTC

Duration: 14min 50sec


  • Opened
    Mar 28, 2023, 4:42 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:57 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 28, 2023, 4:41 PM UTC

Duration: 14min 42sec


  • Opened
    Mar 28, 2023, 4:41 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:56 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: Mar 28, 2023, 4:41 PM UTC

Duration: 15min 15sec


  • Opened
    Mar 28, 2023, 4:41 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:56 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Website

Outage

Opened: Mar 28, 2023, 4:40 PM UTC

Duration: 15min 5sec


  • Opened
    Mar 28, 2023, 4:40 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 28, 2023, 4:55 PM UTC

    Issue resolved on monitor recovery.

March 25, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 25, 2023, 5:05 PM UTC

Duration: 28sec


  • Opened
    Mar 25, 2023, 5:05 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 25, 2023, 5:05 PM UTC

    Issue resolved on monitor recovery.

March 24, 2023

Healthcheck Assertion Failed / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: Mar 24, 2023, 7:07 AM UTC

Duration: 1min 53sec


  • Opened
    Mar 24, 2023, 7:07 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 24, 2023, 7:09 AM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Mar 24, 2023, 7:22 AM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Mar 24, 2023, 7:23 AM UTC

    Issue resolved on monitor recovery.

March 23, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 23, 2023, 8:57 AM UTC

Duration: 25sec


  • Opened
    Mar 23, 2023, 8:57 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 23, 2023, 8:57 AM UTC

    Issue resolved on monitor recovery.

March 22, 2023

Healthcheck Assertion Failed / MGnify Genome Search API (powered by Sourmash)

Outage

Opened: Mar 22, 2023, 8:35 PM UTC

Duration: 10min 20sec


  • Opened
    Mar 22, 2023, 8:35 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 22, 2023, 8:46 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify API

Outage

Opened: Mar 22, 2023, 8:31 PM UTC

Duration: 14min 43sec


  • Opened
    Mar 22, 2023, 8:31 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 22, 2023, 8:46 PM UTC

    Issue resolved on monitor recovery.

March 20, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 20, 2023, 9:45 PM UTC

Duration: 27sec


  • Opened
    Mar 20, 2023, 9:45 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 20, 2023, 9:46 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: Mar 20, 2023, 7:09 PM UTC

Duration: 2min 26sec


  • Opened
    Mar 20, 2023, 7:09 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 20, 2023, 7:11 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 20, 2023, 9:43 AM UTC

Duration: 8min 55sec


  • Opened
    Mar 20, 2023, 9:43 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 20, 2023, 9:52 AM UTC

    Issue resolved on monitor recovery.

March 19, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 19, 2023, 3:35 AM UTC

Duration: 8min 57sec


  • Opened
    Mar 19, 2023, 3:35 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 19, 2023, 3:44 AM UTC

    Issue resolved on monitor recovery.

March 17, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Mar 17, 2023, 11:54 AM UTC

Duration: 8min 8sec


  • Opened
    Mar 17, 2023, 11:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 17, 2023, 12:02 PM UTC

    Issue resolved on monitor recovery.

March 16, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 16, 2023, 7:21 PM UTC

Duration: 28sec


  • Opened
    Mar 16, 2023, 7:21 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 16, 2023, 7:21 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 16, 2023, 4:09 PM UTC

Duration: 9min 37sec


  • Opened
    Mar 16, 2023, 4:09 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 16, 2023, 4:19 PM UTC

    Issue resolved on monitor recovery.

Healthcheck Assertion Failed / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: Mar 16, 2023, 10:03 AM UTC

Duration: 2min 45sec


  • Opened
    Mar 16, 2023, 10:03 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 16, 2023, 10:05 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 16, 2023, 8:24 AM UTC

Duration: 27sec


  • Opened
    Mar 16, 2023, 8:24 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 16, 2023, 8:24 AM UTC

    Issue resolved on monitor recovery.

March 14, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 14, 2023, 2:59 PM UTC

Duration: 9min 34sec


  • Opened
    Mar 14, 2023, 2:59 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 14, 2023, 3:08 PM UTC

    Issue resolved on monitor recovery.

March 12, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 12, 2023, 3:50 AM UTC

Duration: 26sec


  • Opened
    Mar 12, 2023, 3:50 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 12, 2023, 3:50 AM UTC

    Issue resolved on monitor recovery.

March 11, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Mar 11, 2023, 5:00 AM UTC

Duration: 14min 12sec


  • Opened
    Mar 11, 2023, 5:00 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 11, 2023, 5:14 AM UTC

    Issue resolved on monitor recovery.

March 10, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 10, 2023, 8:48 AM UTC

Duration: 7hrs 22min 10sec


  • Opened
    Mar 10, 2023, 8:48 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 10, 2023, 4:10 PM UTC

    Issue resolved on monitor recovery.

March 9, 2023

Protein database sequence search unavailable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 9, 2023, 10:09 PM UTC

Duration: 19hrs 6min 46sec


  • Investigating
    Mar 9, 2023, 10:07 PM UTC

    The PHMMER-backed MGnify sequence search over the MGnify protein database is currently unavailable. We are currently investigating the cause of this.

  • Resolved
    Mar 10, 2023, 5:16 PM UTC

    A configuration issue with the infrastructure caused the outage. This was corrected, and the service is operational. Apologies for the issues this may have caused.

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Mar 9, 2023, 12:08 PM UTC

Duration: 8min 54sec


  • Opened
    Mar 9, 2023, 12:08 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 9, 2023, 12:16 PM UTC

    Issue resolved on monitor recovery.

March 8, 2023

Healthcheck Assertion Failed / MGnify Text Search (powered by EBI Search)

Outage

Opened: Mar 8, 2023, 6:54 PM UTC

Duration: 10min 17sec


  • Opened
    Mar 8, 2023, 6:54 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 8, 2023, 7:04 PM UTC

    Issue resolved on monitor recovery.

March 5, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Mar 5, 2023, 7:21 PM UTC

Duration: 27sec


  • Opened
    Mar 5, 2023, 7:21 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 5, 2023, 7:22 PM UTC

    Issue resolved on monitor recovery.

March 1, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Mar 1, 2023, 5:10 AM UTC

Duration: 35sec


  • Opened
    Mar 1, 2023, 5:10 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Mar 1, 2023, 5:10 AM UTC

    Issue resolved on monitor recovery.

February 27, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Feb 27, 2023, 9:18 AM UTC

Duration: 9min 5sec


  • Opened
    Feb 27, 2023, 9:18 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 27, 2023, 9:27 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Feb 27, 2023, 5:13 AM UTC

Duration: 36sec


  • Opened
    Feb 27, 2023, 5:13 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 27, 2023, 5:13 AM UTC

    Issue resolved on monitor recovery.

February 26, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Feb 26, 2023, 3:31 AM UTC

Duration: 26sec


  • Opened
    Feb 26, 2023, 3:31 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 26, 2023, 3:32 AM UTC

    Issue resolved on monitor recovery.

February 24, 2023

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Feb 24, 2023, 5:42 PM UTC

Duration: 9min 34sec


  • Opened
    Feb 24, 2023, 5:42 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 24, 2023, 5:51 PM UTC

    Issue resolved on monitor recovery.

February 23, 2023

Site Unreachable / MGnify Notebooks Server (EMBL ShinyProxy host)

Outage

Opened: Feb 23, 2023, 5:16 PM UTC

Duration: 2min 43sec


  • Opened
    Feb 23, 2023, 5:16 PM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 23, 2023, 5:17 PM UTC

    Issue resolved on monitor recovery.

  • Unresolved
    Feb 23, 2023, 5:25 PM UTC

    Incident re-opened on monitor failure.

  • Resolved
    Feb 23, 2023, 5:27 PM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Sequence Search (powered by HMMER)

Outage

Opened: Feb 23, 2023, 10:11 AM UTC

Duration: 8min 56sec


  • Opened
    Feb 23, 2023, 10:11 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 23, 2023, 10:20 AM UTC

    Issue resolved on monitor recovery.

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Feb 23, 2023, 3:54 AM UTC

Duration: 9min 14sec


  • Opened
    Feb 23, 2023, 3:54 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 23, 2023, 4:03 AM UTC

    Issue resolved on monitor recovery.

February 22, 2023

Site Unreachable / MGnify Text Search (powered by EBI Search)

Outage

Opened: Feb 22, 2023, 3:48 AM UTC

Duration: 9min 30sec


  • Opened
    Feb 22, 2023, 3:48 AM UTC

    Issue opened on monitor failure.

  • Resolved
    Feb 22, 2023, 3:57 AM UTC

    Issue resolved on monitor recovery.

February 6, 2023

Sourmash Genome Search - results intermittently unavailable / MGnify Genome Search API (powered by Sourmash)

Degraded Performance

Opened: Feb 6, 2023, 11:20 AM UTC

Duration: 8hrs 33min 52sec


  • Identified
    Feb 6, 2023, 11:18 AM UTC

    The Sourmash-based Genome Search has been intermittently returning 500 server errors when viewing search results. The issue has been identified and a fix is being implemented. In the meantime, users can refresh the results page to see their search results.

  • Resolved
    Feb 6, 2023, 7:54 PM UTC

December 15, 2022

Sourmash search temporarily unavailable

Maintenance

Posted: Dec 15, 2022, 3:33 PM UTC


  • Identified
    Dec 15, 2022, 3:31 PM UTC

    The sourmash-backed genome search is temporarily unavailable, whilst we migrate the filesystem used for that service. We apologise for the loss of functionality.

  • Resolved
    Jan 12, 2023, 3:00 PM UTC

December 12, 2022

Instabilities across the service

Degraded Performance

Opened: Dec 12, 2022, 5:41 PM UTC

Duration: 71hrs 2min 25sec


  • Monitoring
    Dec 12, 2022, 5:32 PM UTC

    Multiple parts of the MGnify service are experiencing instabilities currently. We believe this is due to an ongoing migration in the filesystems used by the servers.

  • Resolved
    Dec 15, 2022, 4:44 PM UTC

    The filesystem migration for the core MGnify services is now complete.

October 25, 2022

Sourmash Genome Search - API change

Maintenance

Posted: Oct 25, 2022, 11:33 AM UTC


  • Opened
    Oct 25, 2022, 11:33 AM UTC

    Incident opened on monitor failure.

  • Resolved
    Oct 25, 2022, 11:56 AM UTC

    This incident did not involve any actual downtime. The API options for Sourmash search have changed, to support searching multiple catalogues.

October 21, 2022

EBI Search timeouts

Degraded Performance

Opened: Oct 21, 2022, 7:50 AM UTC

Duration: 14min 56sec


  • Opened
    Oct 21, 2022, 7:50 AM UTC

    Incident opened on monitor failure.

  • Monitoring
    Oct 21, 2022, 7:57 AM UTC
  • Resolved
    Oct 21, 2022, 8:05 AM UTC

    Incident resolved on monitor recovery.

October 20, 2022

COBS Genome Search unavailable

Outage

Opened: Oct 20, 2022, 9:05 AM UTC

Duration: 57min 21sec


  • Opened
    Oct 20, 2022, 9:05 AM UTC

    Incident opened on monitor failure.

  • Resolved
    Oct 20, 2022, 10:02 AM UTC

    This outage was caused by an expired SSL certificate that has now been renewed.