Previous incidents

July 2024
Jul 29, 2024
1 incident

Processing Server (Full + Snippet 0), Processing Server (Snippets + Full 4), ...

Downtime

Resolved Jul 29, 2024 at 5:39pm UTC

PROD Scheduler Server - JobPriority Not 0 and TikTok 0 - JobPriority Not 0 recovered.

14 previous updates
Jul 27, 2024
2 incidents

Processing Server (Full + Snippet 0), Processing Server (Full + Snippet 2), a...

Downtime

Resolved Jul 28, 2024 at 8:59pm UTC

Processing Server (Full + Snippet 0) recovered.

11 previous updates

Processing Server (Full + Snippet 0) and Processing Server (Full + Snippet 2)...

Downtime

Resolved Jul 27, 2024 at 8:45pm UTC

Processing Server (Full + Snippet 0) recovered.

2 previous updates
Jul 25, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved Jul 25, 2024 at 2:05pm UTC

TikTok 2 - JobPriority Not 0 recovered.

10 previous updates
Jul 24, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved Jul 24, 2024 at 6:25am UTC

TikTok 2 - JobPriority Not 0 recovered.

9 previous updates
Jul 17, 2024
1 incident

Processing Server (Full + Snippet 0), PROD Full /Snippet Server 0 - JobPriori...

Downtime

Resolved Jul 17, 2024 at 5:47am UTC

Processing Server (Scheduler) recovered.

13 previous updates
Jul 10, 2024
1 incident

Processing Server (Full + Snippet 0), PROD Full /Snippet Server 0 - JobPriori...

Downtime

Resolved Jul 10, 2024 at 6:49am UTC

PROD Scheduler Server - JobPriority Not 0 recovered.

18 previous updates
Jul 05, 2024
1 incident

Processing Server (Full + Snippet 0), Processing Server (Full + Snippet 1), a...

Downtime

Resolved Jul 6, 2024 at 5:23am UTC

PROD Full /Snippet Server 0 - JobPriority Not 0 recovered.

37 previous updates
Jul 03, 2024
1 incident

Manual Update Cron (FB) is down

Downtime

Resolved Jul 3, 2024 at 4:01pm UTC

Manual Update Cron (FB) recovered.

1 previous update
Jul 01, 2024
1 incident

App Server, PROD Full /Snippet Server 0 - JobPriority Not 0, and 8 other serv...

Downtime

Resolved Jul 1, 2024 at 4:10pm UTC

Manual Update Cron (Source) recovered.

37 previous updates
June 2024
Jun 29, 2024
1 incident

Manual Update Cron (FB) is down

Downtime

Resolved Jun 29, 2024 at 8:39pm UTC

Manual Update Cron (FB) recovered.

1 previous update
Jun 28, 2024
1 incident

Processing Server (Full + Snippet 0), PROD Full /Snippet Server 0 - JobPriori...

Downtime

Resolved Jun 28, 2024 at 8:37pm UTC

Manual Update Cron (FB) recovered.

11 previous updates
Jun 25, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved Jun 27, 2024 at 9:04pm UTC

Manual Update Cron (FB) recovered.

13 previous updates
Jun 24, 2024
1 incident

App Server, PROD Full /Snippet Server 0 - JobPriority Not 0, and 10 other ser...

Downtime

Resolved Jun 24, 2024 at 8:50pm UTC

Manual Update Cron (Source) recovered.

37 previous updates
Jun 22, 2024
1 incident

Manual Update Cron (Source) is down

Downtime

Resolved Jun 23, 2024 at 9:11am UTC

Manual Update Cron (Source) recovered.

1 previous update
Jun 21, 2024
1 incident

Auto Update Cron (Source) and Manual Update Cron (FB) are down

Downtime

Resolved Jun 22, 2024 at 7:30am UTC

Manual Update Cron (FB) recovered.

3 previous updates
Jun 20, 2024
1 incident

Processing Server (Scheduler), PROD Scheduler Server - JobPriority Not 0, and...

Downtime

Resolved Jun 21, 2024 at 9:02pm UTC

Manual Update Cron (FB) recovered.

17 previous updates
Jun 18, 2024
1 incident

Auto Update Cron (Source), Manual Update Cron (Source), and 1 other service a...

Downtime

Resolved Jun 19, 2024 at 8:16pm UTC

Manual Update Cron (Source) recovered.

7 previous updates
Jun 14, 2024
2 incidents

Auto Update Cron (Source) and Manual Update Cron (FB) are down

Downtime

Resolved Jun 15, 2024 at 7:21am UTC

Manual Update Cron (FB) recovered.

3 previous updates

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved Jun 14, 2024 at 9:02pm UTC

Manual Update Cron (FB) recovered.

10 previous updates
Jun 13, 2024
1 incident

Auto Update Cron (Source) and Manual Update Cron (FB) are down

Downtime

Resolved Jun 13, 2024 at 8:45pm UTC

Manual Update Cron (FB) recovered.

5 previous updates
Jun 11, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved Jun 12, 2024 at 9:15pm UTC

Manual Update Cron (FB) recovered.

14 previous updates
Jun 10, 2024
2 incidents

Processing Server (Full + Snippet 0), PROD Full /Snippet Server 0 - JobPriori...

Downtime

Resolved Jun 11, 2024 at 8:03am UTC

Manual Update Cron (FB) recovered.

15 previous updates

App Server, Processing Server (Scheduler), and 9 other services are down

Downtime

Resolved Jun 10, 2024 at 2:30pm UTC

Manual Update Cron (FB) recovered.

24 previous updates
Jun 09, 2024
1 incident

Processing Server (Full + Snippet 0), Processing Server (Full + Snippet 1), a...

Downtime

Resolved Jun 9, 2024 at 9:46pm UTC

Manual Update Cron (FB) recovered.

15 previous updates
Jun 08, 2024
1 incident

Manual Update Cron (FB) is down

Downtime

Resolved Jun 8, 2024 at 8:00am UTC

Manual Update Cron (FB) recovered.

1 previous update
Jun 06, 2024
2 incidents

PROD Scheduler Server - JobPriority Not 0, Manual Update Cron (Source), and 2...

Downtime

Resolved Jun 7, 2024 at 9:39pm UTC

Manual Update Cron (FB) recovered.

8 previous updates

Manual Update Cron (FB) is down

Downtime

Resolved Jun 6, 2024 at 7:35am UTC

Manual Update Cron (FB) recovered.

1 previous update
Jun 04, 2024
1 incident

App Server, PROD Full /Snippet Server 0 - JobPriority Not 0, and 9 other serv...

Downtime

Resolved Jun 5, 2024 at 9:29pm UTC

Manual Update Cron (FB) recovered.

20 previous updates
Jun 02, 2024
1 incident

Auto Update Cron (Source) and Manual Update Cron (FB) are down

Downtime

Resolved Jun 3, 2024 at 10:22pm UTC

Manual Update Cron (FB) recovered.

7 previous updates
Jun 01, 2024
1 incident

Manual Update Cron (FB) is down

Downtime

Resolved Jun 1, 2024 at 9:18pm UTC

Manual Update Cron (FB) recovered.

1 previous update
May 2024
May 30, 2024
1 incident

Auto Update Cron (Source) and Manual Update Cron (FB) are down

Downtime

Resolved May 31, 2024 at 9:49pm UTC

Manual Update Cron (FB) recovered.

5 previous updates
May 28, 2024
1 incident

Manual Update Cron (Source) and Manual Update Cron (FB) are down

Downtime

Resolved May 29, 2024 at 9:53am UTC

Manual Update Cron (Source) recovered.

5 previous updates
May 27, 2024
1 incident

Auto Update Cron (Source), Manual Update Cron (Source), and 1 other service a...

Downtime

Resolved May 27, 2024 at 9:47pm UTC

Manual Update Cron (FB) recovered.

7 previous updates
May 26, 2024
1 incident

Manual Update Cron (FB) is down

Downtime

Resolved May 26, 2024 at 9:44pm UTC

Manual Update Cron (FB) recovered.

3 previous updates
May 22, 2024
1 incident

Processing Server (Full + Snippet 0), Processing Server (Full + Snippet 1), a...

Downtime

Resolved May 25, 2024 at 9:24pm UTC

Manual Update Cron (FB) recovered.

63 previous updates
May 20, 2024
1 incident

Auto Update Cron (Source), Manual Update Cron (FB), and 1 other service are down

Downtime

Resolved May 21, 2024 at 5:50am UTC

Manual Update Cron (FB) recovered.

5 previous updates
May 19, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved May 20, 2024 at 7:26am UTC

TikTok 2 - JobPriority Not 0 recovered.

14 previous updates
May 17, 2024
1 incident

Processing Server (Full + Snippet 0), Processing Server (Full + Snippet 1), a...

Downtime

Resolved May 17, 2024 at 6:42am UTC

Processing Server (Scheduler) recovered.

37 previous updates
May 16, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved May 16, 2024 at 11:40am UTC

Manual Update Cron (FB) recovered.

19 previous updates
May 15, 2024
1 incident

Auto Update Cron (Source), Manual Update Cron (FB), and 1 other service are down

Downtime

Resolved May 15, 2024 at 11:57pm UTC

Auto Update Cron (Source) recovered.

7 previous updates
May 14, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved May 14, 2024 at 7:08pm UTC

Manual Update Cron (FB) recovered.

11 previous updates
May 13, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved May 13, 2024 at 5:44pm UTC

PROD Full /Snippet Server 1 - JobPriority Not 0 and TikTok 3 - JobPriority Not 0 recovered.

41 previous updates
May 11, 2024
1 incident

Manual Update Cron (Source) is down

Downtime

Resolved May 12, 2024 at 11:06am UTC

Manual Update Cron (Source) recovered.

1 previous update
May 09, 2024
2 incidents

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved May 10, 2024 at 11:29am UTC

PROD Full /Snippet Server 0 - JobPriority Not 0 recovered.

22 previous updates

Processing Server (TikTok 2), Processing Server (TikTok 5), and 8 other servi...

Downtime

Resolved May 9, 2024 at 11:12pm UTC

PROD Full /Snippet Server 1 - JobPriority Not 0 recovered.

57 previous updates
May 07, 2024
1 incident

Some services are down

Downtime

Resolved May 7, 2024 at 2:09pm UTC

Auto Schedule Jobs Queue went down.
May 04, 2024
1 incident

Manual Update Cron (FB) is down

Downtime

Resolved May 4, 2024 at 11:42pm UTC

Manual Update Cron (FB) recovered.

1 previous update
May 02, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved May 2, 2024 at 7:14pm UTC

TikTok 1 - JobPriority Not 0 and TikTok 2 - JobPriority Not 0 recovered.

27 previous updates
May 01, 2024
1 incident

PROD Full /Snippet Server 0 - JobPriority Not 0, PROD Full /Snippet Server 1 ...

Downtime

Resolved May 1, 2024 at 9:43pm UTC

TikTok 0 - JobPriority Not 0 recovered.

44 previous updates