Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Short name

Operational KPIs

Baseline 30/04/15
(end of GN3plus)

Target 30/04/16
(end of GN4-1)[1]

Measured 30/04/16
(end of GN4-1)

Explanation
KPI 1

International eduroam authentications per month

31,832,243

26,000,000

47,339,724

Counts sucessful successful authentication requests that pases pass ETLR servers,

per month (monthly traffic) as specified in the table row and column titles

KPI 2National eduroam authentications per month147,726,234117,000,000215,597,792

Counts successful authentication requests that pases pass (only) FTLR servers,

per month (monthly traffic)as specified in the table row and column titles

[1] The target figure for end GN4-1 was set a number of months before the project began and is therefore lower than the baseline. The actual achieved growth exceeds that which would have been predicted with the same methodology of the original predictions.

...

*NRENs and end-users where applicable 

...

NREN uptake

In the beginning of GN4-1 there were 44 European NRENs/NROs  that were using eduroam serviceDuring GN4-1 two new European NRENs/NROs joined eduroam: Georgia and Ukraine, resulting in 46 NROs from Europe (see monitor.eduroam,org).  

NOTE: European NRO != GÉANT participant (e.g. NORDUNET is one GÉANT participant represented by 5 NROs; GEANT org is GÉANT participant and not an NRO; Andorra, Azerbaijan, Georgia, Kazakhstan, Kyrgyzstan and Russia are not GÉANT participants but have European NROs)

All GÉANT participants are using eduroam service. 


Usage uptake

The eduroam service continues to see significant growth, both within countries and across borders. Seasonal fluctuations are evident, linking with main academic holiday seasons and new terms, but on a month-to-month comparison, every month saw growth based on the previous year at national and international levels. The start of the academic year 2015-2016 was performed particularly strongly.

Growth of eduroam national roaming authentications : GN3plus and GN4-1

Growth of eduroam international roaming authentications: GN3plus and GN4-1

 At

the end of the reporting period, the Another means to track eduroam uptake is to measure usage of eduroam supporting tool CAT had 1281 supported IdPs, over 1000 of which are fully configured. During the period, 1,262,104 downloads were delivered, 1,259,842 of which were end user profiles. do we have numbers at beginning of GN4-1 ? - ( May. 2015: we  had 880 IdPs, 699  fully configured, and total of 1,682.377 downloads since the day of the service launch in GN3plus). The tool is used by IdPs (end-users institution) who configure their institution "profile", and ultimately by end-users who download eduroam installers for their device.

 GN4-1 start
1. May 2015
GN4-1 end
30. April 2016
Number of IdPs in CAT tool8801281
Number of IdPs fully configured in the CAT tool6991093
Number of end-user downloads of installers from CAT tool1,682.377 * 3.877.511*

*measured from the day of release of the CAT tool in GN3plus

 

 

Image Modified

Distribution of CAT downloads per type of user device OS

 

During GN4-1 two new NROs joined eduroam, Georgia and Ukraine (Totall NRO count =46, see monitor.eduroam,org)  what was the number of NROs in beginning of GN4-1 = 44 , and what is the number of geant pariticipants in gn4-1. Who didnt join and why. NOTE: NRO != GN participant (e.g. NORDUNET, GEANT org). All joined.AFAIK


Devops Roadmap 

*Roadmap should cover cover upto next year, with more details on plans for next quarter

...

Current eduroam devops roadmap is available at the  eduroam Devops Roadmap

Snapshot of the roadmap taken for this review on  

PDF
nameeduroam Devops Roadmap-snapshot for GN4-1 service review.pdf
Miro, can you please provide a roadmap even better at eduroam Devops Roadmap  ... We can than put a url to that roadmap here.  . Roadmap is currently under construction


Development Roadmap 

*Roadmap should cover next 2-3 years, and show where we are on it

Input needed from JRA3 Ann Harding Roadmap is currently under construction - we have one roadmap?

...

In GN4-2 JRA3 is responsible for further development of eduroam service. The roadmap was discussed during the Project Management Convention, resulting in the following:

  • eduroam as a service - eaas - detailed roadmap 
    • Overall system design specified – DONE
    • Implement first prototype – ONGOING
    • finalize first prototype for the service – Dec 2016 [COMMITED]
    • launch pilot for the service – Jan 2017 [COMMITED]
          -> functional except credential revocation; preliminary UI; see “Pilot Features”
    • stop the pilot – May 2017 [PLANNED]
    • eaas beta version – June 2017 [PLANNED]
          -> fully functional, near-final UIs; see “Beta Features”
    • eaas v1.0 – July 2017 [PLANNED]
    • documentation and acceptance testing – Sep 2017 [POSSIBILITY]
    • service launch and handover to production – Oct 2017 [POSSIBILITY]
  • eduroam user diagnostics
    • analyse requirements - Dec 2016
    • start development - Jan 2017
    • finalize prototype - June 2017
    • early adopters release and acceptance testing- July 2017
    • service launch - Oct 2017
  • radsec scalability
  • CAT development

Image Added 

Service availability and incidents

*Including any security breaks

...

Miro please add. No  No security breaks


Usage and scalability issues

...

Miro please add. NO issues we are aware off

 

Support, operations and devops effort spent and planned Ask Ann to provide numbers from the SA5 budget. 

...

Caution: Reporting on spent manpower in GEANT projects is not conceptualised for easy and accurate tracking of spent manpower for different services and for different aspects of work on those services (ie what was spent on development, support or operations). For GN4-1, it comes down on how much individual person claimed under certain task. eduroam development and operations were performed under same task in GN4-1 and therefore its impossible to make such differentiation at this point. 

SA5 TaskSpentBudgetType of performed work
T7 - eduroam   310.850,83 €   335.333,74 €eduroam development and operations


Proposal for additional KPIs related to usage, uptake and costs

Ann, Miro something to add ?

...

Although GN4-2 Technical Annex does not have details on target values for KPIs, we have projected the target based on the current rate of usage growth and expected changes in the market. It is expected that growth of eduroam will be slower than in previous years due to full coverage/use in many organisations, and the potential impact of the abolition of roaming data charges in the EU. Nonetheless, as eduroam delivers more value than simply cost of network access, growth is still expected.

Short name

Operational KPIs

Baseline 30/04/16
(end of GN4-1)

Target
M8 of GN4-2 [1] 

Target
M20 of GN4-2

Target
M32 of GN4-2
Explanation
KPI 1

International eduroam authentications per month

47,339,724

43,000,000

49,000,000

55,000,000

Counts sucessful successful authentication requests that pases ETLR serversfor which time interval are those numbers - what is the start point - see abovepasses ETLR servers, monthly average

KPI 2National eduroam authentications per month215,597,792180,000,000207,000,000228,000,000

Counts successful authentication requests that pases passes (only) FTLR serversfor which time interval are those numbers - what is the start point - see above, monthly average

 [1] The target figure for end GN4-1 was set a number of months before the project began and is therefore lower than the baseline. The actual achieved growth exceeds that which would have been predicted with the same methodology of the original predictions.


Any Other Issues

...

 Miro  please addDuring the GN4-1 period, eduroam service had following notable tasks performed: 

  • First level support was migrated to

...

  • GÉANT OC
  • The first draft of

...

  • eduroam db ver 2.0 spec.

...

  • was released

 

  • As a basis for eduroam as a service - eaaS service offering, Deliverable  D9.3 Service Approach Specification to Small Site eduroam Adoption was released on Feb 2016
  • monitor.eduroam.org and www.eduroam.org web sites have been reworked

 

  (Feb 2016) - basis for eaaS