The purpose of this review is perform a revision of the services, at the point when we are exiting the GN4-1 timeframe. The review should reflect the period of GN4-1: 1. May 2015 - 30. April 2016, and the roadmap for the next time frame of 2-3 years.
Service (Operational) Manager
Miroslav Milinović
KPIs
| Short name | Operational KPIs | Baseline 30/04/15 | Target 30/04/16 | Measured 30/04/16 | Explanation |
|---|---|---|---|---|---|
| KPI 1 | International eduroam authentications per month | 31,832,243 | 26,000,000 | 47,339,724 | Counts successful authentication requests that pass ETLR servers, per month (monthly traffic) |
| KPI 2 | National eduroam authentications per month | 147,726,234 | 117,000,000 | 215,597,792 | Counts successful authentication requests that pass (only) FTLR servers, per month (monthly traffic) |
[1] The target figure for end GN4-1 was set a number of months before the project began and is therefore lower than the baseline. The actual achieved growth exceeds that which would have been predicted with the same methodology of the original predictions.
Uptake trends
*NRENs and end-users where applicable
NREN uptake
In the beginning of GN4-1 there were 44 European NRENs/NROs that were using eduroam service. During GN4-1 two new European NRENs/NROs joined eduroam: Georgia and Ukraine, resulting in 46 NROs from Europe (see monitor.eduroam,org).
NOTE: European NRO != GÉANT participant (e.g. NORDUNET is one GÉANT participant represented by 5 NROs; GEANT org is GÉANT participant and not an NRO; Andorra, Azerbaijan, Georgia, Kazakhstan, Kyrgyzstan and Russia are not GÉANT participants but have European NROs)
All GÉANT participants are using eduroam service.
Usage uptake
The eduroam service continues to see significant growth, both within countries and across borders. Seasonal fluctuations are evident, linking with main academic holiday seasons and new terms, but on a month-to-month comparison, every month saw growth based on the previous year at national and international levels. The start of the academic year 2015-2016 was performed particularly strongly.
Growth of eduroam national roaming authentications : GN3plus and GN4-1 |
Growth of eduroam international roaming authentications: GN3plus and GN4-1 |
Another means to track eduroam uptake is to measure usage of eduroam supporting tool CAT. The tool is used by IdPs (end-users institution) who configure their institution "profile", and ultimately by end-users who download eduroam installers for their device.
| GN4-1 start 1. May 2015 | GN4-1 end 30. April 2016 | |
|---|---|---|
| Number of IdPs in CAT tool | 880 | 1281 |
| Number of IdPs fully configured in the CAT tool | 699 | 1093 |
| Number of end-user downloads of installers from CAT tool | 1,682.377 * | 3.877.511* |
*measured from the day of release of the CAT tool in GN3plus
Distribution of CAT downloads per type of user device OS |
Devops Roadmap
*Roadmap should cover cover upto next year, with more details on plans for next quarter
Current eduroam devops roadmap is available at the eduroam Devops Roadmap
Snapshot of the roadmap taken for this review on
Development Roadmap
*Roadmap should cover next 2-3 years, and show where we are on it
In GN4-2 JRA3 is responsible for further development of eduroam service. The roadmap was discussed during the Project Management Convention, resulting in the following:
- eduroam as a service - eaas - detailed roadmap
- Overall system design specified – DONE
- Implement first prototype – ONGOING
- finalize first prototype for the service – Dec 2016 [COMMITED]
- launch pilot for the service – Jan 2017 [COMMITED]
-> functional except credential revocation; preliminary UI; see “Pilot Features” - stop the pilot – May 2017 [PLANNED]
- eaas beta version – June 2017 [PLANNED]
-> fully functional, near-final UIs; see “Beta Features” - eaas v1.0 – July 2017 [PLANNED]
- documentation and acceptance testing – Sep 2017 [POSSIBILITY]
- service launch and handover to production – Oct 2017 [POSSIBILITY]
- eduroam user diagnostics
- analyse requirements - Dec 2016
- start development - Jan 2017
- finalize prototype - June 2017
- early adopters release and acceptance testing- July 2017
- service launch - Oct 2017
- radsec scalability
- CAT development
Service availability and incidents
*Including any security breaks
No security breaks
Usage and scalability issues
NO issues we are aware off
Support, operations and devops effort spent and planned
Caution: Reporting on spent manpower in GEANT projects is not conceptualised for easy and accurate tracking of spent manpower for different services and for different aspects of work on those services (ie what was spent on development, support or operations). For GN4-1, it comes down on how much individual person claimed under certain task. eduroam development and operations were performed under same task in GN4-1 and therefore its impossible to make such differentiation at this point.
| SA5 Task | Spent | Budget | Type of performed work |
|---|---|---|---|
| T7 - eduroam | 310.850,83 € | 335.333,74 € | eduroam development and operations |
Proposal for additional KPIs related to usage, uptake and costs
Although GN4-2 Technical Annex does not have details on target values for KPIs, we have projected the target based on the current rate of usage growth and expected changes in the market. It is expected that growth of eduroam will be slower than in previous years due to full coverage/use in many organisations, and the potential impact of the abolition of roaming data charges in the EU. Nonetheless, as eduroam delivers more value than simply cost of network access, growth is still expected.
| Short name | Operational KPIs | Baseline 30/04/16 | Target | Target M32 of GN4-2 | Explanation | |
|---|---|---|---|---|---|---|
| KPI 1 | International eduroam authentications per month | 47,339,724 | 43,000,000 | 49,000,000 | 55,000,000 | Counts successful authentication requests that passes ETLR servers, monthly average |
| KPI 2 | National eduroam authentications per month | 215,597,792 | 180,000,000 | 207,000,000 | 228,000,000 | Counts successful authentication requests that passes (only) FTLR servers, monthly average |
[1] The target figure for end GN4-1 was set a number of months before the project began and is therefore lower than the baseline. The actual achieved growth exceeds that which would have been predicted with the same methodology of the original predictions.
Any Other Issues
During the GN4-1 period, eduroam service had following notable tasks performed:
- First level support was migrated to GÉANT OC
- The first draft of eduroam db ver 2.0 spec. was released
- As a basis for eduroam as a service - eaaS service offering, Deliverable D9.3 Service Approach Specification to Small Site eduroam Adoption was released on Feb 2016
- monitor.eduroam.org and www.eduroam.org web sites have been reworked