Timelag on EA English (en) français (fr)

From thinktank

Jump to: navigation, search

The Time-lag (or Backlog) is one of the KPIs of Europa Analytics (EA). It is defined here as the difference between the date of today and the date of latest loaded data.

This Time-lag is due to the time needed to collect, load and process the data (ETL) procedure currently applied on the EA.

Goals

Goal since 2010
The goal is to reach the time-lag of maximum 48 hours.
The goal has been practically reached after the migration to the new version of the EA with improved ETL.
Goal for future
The goal is to reach the time-lag of maximum 24 hours.
The procedure to collect the data by DIGIT will have to be substantially changed (with subsequent changes in the EA ETL).

Current Time-Lag

Via the report Available Data current time-lag could be found by checking the value of the Latest Date (= read latest date for which the data has been loaded).

The 'Time-lag'='Today' - 'Latest Date'; and should be not higher than 2 days.

Comparing to the previous version (marked as SAS WH) the time-lag has been significantly reduced. (Exception in July 2010, when system has stopped due to problems with installation of a corrective patch.)

The expansion of the Timelag in the period January - May 2011 was due to the incident in DataCenter and then by needed fixes.

Evolution of the time-lag up to 31 December 2014

Details day-by-day

January 2015

Date Latest Date Time lag
31/01/2015 28/01/2015 3 days
30/01/2015 28/01/2015 2 days
29/01/2015 26/01/2015 3 days
28/01/2015 26/01/2015 2 days
27/01/2015 25/01/2015 2 days
26/01/2015 24/01/2015 2 days
25/01/2015 23/01/2015 2 days
24/01/2015 21/01/2015 3 days
23/01/2015 21/01/2015 2 days
22/01/2015 19/01/2015 3 days
21/01/2015 17/01/2015 4 days
20/01/2015 17/01/2015 3 days
19/01/2015 17/01/2015 2 days
18/01/2015 15/01/2015 3 days
17/01/2015 14/01/2015 3 days
16/01/2015 13/01/2015 3 days
15/01/2015 10/01/2015 5 days
14/01/2015 09/01/2015 5 days
13/01/2015 07/01/2015 6 days
12/01/2015 07/01/2015 5 days
11/01/2015 05/01/2015 6 days
10/01/2015 03/01/2015 7 days
09/01/2015 02/01/2015 7 days
08/01/2015 31/12/2014 8 days
07/01/2015 30/12/2014 8 days
06/01/2015 28/12/2014 9 days
05/01/2015 25/12/2014 11 days
04/01/2015 25/12/2014 10 days
03/01/2015 25/12/2014 9 days
02/01/2015 25/12/2014 8 days
01/01/2015 25/12/2014 7 days

December 2014

Date Latest Date Time lag
31/12/2014 25/12/2014 6 days
30/12/2014 25/12/2014 5 days
29/12/2014 25/12/2014 4 days
28/12/2014 25/12/2014 3 days
27/12/2014 25/12/2014 2 days
26/12/2014 24/12/2014 2 days
25/12/2014 24/12/2014 1 day
24/12/2014 23/12/2014 1 day
23/12/2014 22/12/2014 1 day
22/12/2014 19/12/2014 3 days
21/12/2014 18/12/2014 3 days
20/12/2014 17/12/2014 3 days
19/12/2014 16/12/2014 3 days
18/12/2014 15/12/2014 3 days
17/12/2014 14/12/2014 3 days
16/12/2014 14/12/2014 2 days
15/12/2014 13/12/2014 2 days
14/12/2014 11/12/2014 3 days
13/12/2014 10/12/2014 3 days
12/12/2014 10/12/2014 2 days
11/12/2014 07/12/2014 4 days
10/12/2014 05/12/2014 5 days
09/12/2014 04/12/2014 5 days
08/12/2014 04/12/2014 4 days
07/12/2014 03/12/2014 4 days
06/12/2014 03/12/2014 3 days
05/12/2014 03/12/2014 2 days
04/12/2014 02/12/2014 2 days
03/12/2014 01/12/2014 2 days
02/12/2014 29/11/2014 3 days
01/12/2014 28/11/2014 3 days


November 2014

Date Latest Date Time lag
30/11/2014 26/11/2014 4 days
29/11/2014 26/11/2014 3 days
28/11/2014 25/11/2014 3 days
27/11/2014 24/11/2014 3 days
26/11/2014 22/11/2014 4 days
25/11/2014 20/11/2014 5 days
24/11/2014 20/11/2014 4 days
23/11/2014 20/11/2014 3 days
22/11/2014 20/11/2014 2 days
21/11/2014 20/11/2014 1 day
20/11/2014 19/11/2014 1 day
19/11/2014 17/11/2014 2 days
18/11/2014 15/11/2014 2 days
17/11/2014 14/11/2014 3 days
16/11/2014 12/11/2014 4 days
15/11/2014 11/11/2014 4 days
14/11/2014 11/11/2014 3 days
13/11/2014 10/11/2014 3 days
12/11/2014 10/11/2014 2 days
11/11/2014 08/11/2014 3 days
10/11/2014 07/11/2014 3 days
09/11/2014 06/11/2014 3 days
08/11/2014 05/11/2014 3 days
07/11/2014 04/11/2014 3 days
06/11/2014 03/11/2014 3 days
05/11/2014 02/11/2014 3 days
04/11/2014 01/11/2014 3 days
03/11/2014 30/10/2014 4 days
02/11/2014 29/10/2014 4 days
01/11/2014 29/10/2014 3 days

October 2014

Date Latest Date Time lag
31/10/2014 28/10/2014 3 days
30/10/2014 28/10/2014 2 days
29/10/2014 26/10/2014 3 days
28/10/2014 26/10/2014 2 days
27/10/2014 24/10/2014 3 days
26/10/2014 22/10/2014 4 days
25/10/2014 20/10/2014 5 days
24/10/2014 20/10/2014 4 days
23/10/2014 19/10/2014 4 days
22/10/2014 19/10/2014 3 days
21/10/2014 18/10/2014 3 days
20/10/2014 17/10/2014 3 days
19/10/2014 15/10/2014 4 days
18/10/2014 13/10/2014 5 days
17/10/2014 12/10/2014 5 days
16/10/2014 12/10/2014 4 days
15/10/2014 11/10/2014 4 days
14/10/2014 11/10/2014 3 days
13/10/2014 10/10/2014 3 days
12/10/2014 08/10/2014 4 days
11/10/2014 07/10/2014 4 days
10/10/2014 06/10/2014 4 days
09/10/2014 06/10/2014 3 days
08/10/2014 06/10/2014 2 days
07/10/2014 03/10/2014 4 days
06/10/2014 02/10/2014 4 days
05/10/2014 30/09/2014 5 days
04/10/2014 28/09/2014 6 days
03/10/2014 27/09/2014 6 days
02/10/2014 26/09/2014 6 days
01/10/2014 25/09/2014 6 days

September 2014

Date Latest Date Time lag
30/09/2014 25/09/2014 5 days
29/09/2014 23/09/2014 6 days
28/09/2014 23/09/2014 5 days
27/09/2014 23/09/2014 4 days
26/09/2014 23/09/2014 3 days
25/09/2014 23/09/2014 2 days
24/09/2014 23/09/2014 1 day
23/09/2014 22/09/2014 1 day
23/09/2014 22/09/2014 1 day
22/09/2014 20/09/2014 2 days
21/09/2014 19/09/2014 2 days
20/09/2014 18/09/2014 2 days
19/09/2014 18/09/2014 1 day
18/09/2014 17/09/2014 1 day
17/09/2014 15/09/2014 2 days
16/09/2014 15/09/2014 1 day
15/09/2014 13/09/2014 2 days
14/09/2014 12/09/2014 2 days
13/09/2014 11/09/2014 2 days
12/09/2014 10/09/2014 2 days
11/09/2014 09/09/2014 2 days
10/09/2014 08/09/2014 2 days
09/09/2014 08/09/2014 1 day
08/09/2014 06/09/2014 2 days
07/09/2014 05/09/2014 2 days
06/09/2014 04/09/2014 2 days
05/09/2014 03/09/2014 2 days
04/09/2014 03/09/2014 1 day
03/09/2014 01/09/2014 2 days
02/09/2014 31/08/2014 2 days
01/09/2014 29/08/2014 3 days

August 2014

Date Latest Date Time lag
31/08/2014 27/08/2014 4 days
30/08/2014 26/08/2014 4 days
29/08/2014 24/08/2014 5 days
28/08/2014 23/08/2014 5 days
27/08/2014 22/08/2014 5 days
26/08/2014 21/08/2014 5 days
25/08/2014 21/08/2014 4 days
24/08/2014 21/08/2014 3 days
23/08/2014 20/08/2014 3 days
22/08/2014 20/08/2014 2 days
21/08/2014 19/08/2014 2 days
20/08/2014 18/08/2014 2 days
19/08/2014 18/08/2014 1 days
18/08/2014 15/08/2014 3 days
17/08/2014 14/08/2014 3 days
16/08/2014 12/08/2014 4 days
15/08/2014 10/08/2014 5 days
14/08/2014 09/08/2014 5 days
13/08/2014 08/08/2014 5 days
12/08/2014 07/08/2014 5 days
11/08/2014 06/08/2014 5 days
10/08/2014 05/08/2014 5 days
09/08/2014 04/08/2014 5 days
08/08/2014 02/08/2014 6 days
07/08/2014 01/08/2014 6 days
06/08/2014 30/07/2014 7 days
05/08/2014 28/07/2014 8 days
04/08/2014 27/07/2014 8 days
03/08/2014 25/07/2014 9 days
02/08/2014 23/07/2014 10 days
01/08/2014 22/07/2014 10 days

July 2014

Date Latest Date Time lag
31/07/2014 20/07/2014 11 days
30/07/2014 18/07/2014 12 days
29/07/2014 16/07/2014 13 days
28/07/2014 13/07/2014 15 days
27/07/2014 12/07/2014 15 days
26/07/2014 11/07/2014 15 days
25/07/2014 10/07/2014 15 days
24/07/2014 09/07/2014 15 days
23/07/2014 07/07/2014 16 days
22/07/2014 05/07/2014 16 days
21/07/2014 05/07/2014 15 days
20/07/2014 05/07/2014 14 days
19/07/2014 05/07/2014 13 days
18/07/2014 05/07/2014 13 days
17/07/2014 05/07/2014 12 days
16/07/2014 05/07/2014 11 days
15/07/2014 05/07/2014 10 days
14/07/2014 05/07/2014 09 days
13/07/2014 05/07/2014 08 days
12/07/2014 05/07/2014 07 days
11/07/2014 05/07/2014 06 days
10/07/2014 05/07/2014 05 days
09/07/2014 07/07/2014 02 days
08/07/2014 07/07/2014 01 day
07/07/2014 05/07/2014 02 days
06/07/2014 04/07/2014 02 days
05/07/2014 03/07/2014 02 days
04/07/2014 02/07/2014 02 days
03/07/2014 01/07/2014 02 days
02/07/2014 30/06/2014 02 days
01/07/2014 29/06/2014 02 days

June 2014

Date Latest Date Time lag
30/06/2014 28/06/2014 02 days
29/06/2014 27/06/2014 02 days
28/06/2014 26/06/2014 02 days
27/06/2014 26/06/2014 01 day
26/06/2014 24/06/2014 02 days
25/06/2014 23/06/2014 02 days
24/06/2014 23/06/2014 01 day
23/06/2014 21/06/2014 02 days
22/06/2014 19/06/2014 03 days
21/06/2014 19/06/2014 02 days
20/06/2014 18/06/2014 02 days
19/06/2014 18/06/2014 01 day
18/06/2014 17/06/2014 01 day
17/06/2014 14/06/2014 03 days
16/06/2014 12/06/2014 04 days
15/06/2014 09/06/2014 06 days
14/06/2014 08/06/2014 06 days
13/06/2014 07/06/2014 06 days
12/06/2014 05/06/2014 07 days
11/06/2014 05/06/2014 06 days
11/06/2014 05/06/2014 06 days
10/06/2014 04/06/2014 06 days
09/06/2014 02/06/2014 07 days
08/06/2014 31/05/2014 08 days
07/06/2014 29/05/2014 09 days
06/06/2014 28/05/2014 09 days
05/06/2014 26/05/2014 10 days
04/06/2014 24/05/2014 11 days
03/06/2014 22/05/2014 12 days
02/06/2014 21/05/2014 12 days
01/06/2014 20/05/2014 12 days

May 2014

Date
Latest Date
Time lag
31/05/2014
18/05/2014
13 days
30/05/2014
16/05/2014
14 days
29/05/2014
14/05/2014
15 days
28/05/2014
14/05/2014
14 days
27/05/2014
13/05/2014
14 days

Variations of the Time-Lag

  1. The Latest Date has to be taken with a lot of caution. It happens that not all log files are delivered in time and they come the day after. It may be even several % of the data which delivered later. There for it is better to take a day before the Last Date if 100% accuracy is needed.


Personal tools