PS-CRIMSON Research Project, ITEA3

Public Safety & Crisis Management Service Orchestration

News and Progress
15.01.2020
Several pilot projects are launched to valorize the platform of PS-CRIMSON
A pilot with National Dutch Police for security management, a pilot with Utrecht for Vuelta 2020 and a pilot with Rotterdam to supply public safety for Eurovisie 2020 are established to productize the platform.

29.11.2019
PS-CRIMSON platform opens possibility for Smart City project in Guelph, Ontario
ATOS and Esri Canada are working on a potential Smart City project for City of Guelph, Ontario, where the PS-CRIMSON platform will be used as a foundament.

30.10.2019
Maui County introduces PS-CRIMSON based 3D mapping by Esri Canada
The 3D modelling technology developed by Esri Canada for the ITEA project PS-CRIMSON has proven to be of great value for other public authorities. The County of Maui is using similar three-dimensional modelling technology to visualise property data with the help of Esri’s structural 3D models of buildings.
Maui County news.

07.06.2019
Smart City Platform in Hilversum will be based on PS-CRIMSON
The project partners have won the Tender for Smart City Platform Hilversum in a consortium of Atos, ESRI, ViNotion, Sorama (and others). D1.3 architecture is a baseline for production space, sandboxing in innovation space.
Smart City Hilversum.

31.05.2019
Winning Tender on Panic Detection for Dutch Railway (NS)
For PS-CRIMSON we develop behavior analysis based on crowd motion patterns. This functionality is now being implemented for the Dutch railways (NS)

30.04.2019
Presentation of PS-CRIMSON at two conferences: GIS/CAMA Technologies and IAAO
The project was presented by Esti Canada at the GIS/CAMA Technologies Conference 2019, February 25 to 28 in Portland, Oregon, and at the API and IAAO International Research Symposium, April 30 to May 2 2019 in Melbourne, Australia

07.04.2019
Winning the Inbraakvrije Wijk project in Rotterdam
Vinotion, Atos and Sorama have won the tender on public safety Inbraakvrije Wijk project in Rotterdam. The system will be based on the PS-CRIMSON platform parts.

01.12.2018
PS-CRIMSON project was presented in the Smart City Expo World Congress in Barcelona
Vinotion and Esri Canada, on behalf of the other project partners, presented the project achievements and established networking for further exploitation.
More info - Smart City Expo Barcelona 2018.

31.10.2018
Project results in Cursor newspaper
The technologies and results of the PS-CRIMSON and PaSSANT surveillance projects have been published the weekly Cursor newspaper: Tracking down smugglers and refugees with ‘smart’ cameras

20.09.2018
Successful second-year ITEA Project Review
In september, we have performed a productive presentation of the project progress results for the ITEA review committee. With a valueable feedback and positive evaluation from the ITEA experts, we continue on the track planned.

25.05.2018
PS-CRIMSON Project Presentation at the ITEA-EUREKA Innovation Days 2018, Helsinki
Project partners presented the stand, on which the prototypes of the acoustic and visual sensors has been presented. Besides this, we have shown the project idea, progress and plans for the future.

09.02.2018
PS-CRIMSON Workshop Involving All Project Partners in Istanbul, Turkey
The workshop between Dutch, Canadese and Turkish partners has focused on discussions about collaboration on use-case level and integration options with a focus on types of data being shared. Discussions on these are finalized the coming months, and in May a F2F meeting is organized to discuss the integration on the technical level.

03.01.2018
PS-CRIMSON Project Presentation at the Industrial OCIO Connect Conference 2017 in Victoria, Canada
The presentation of the PS-CRIMSON project has been performed at the industrial OCIO Connect Conference 2017 in Victoria, Canada. More details about this presentation: Crimson Project - A Smart Cities’ Initiative on Public Safety and Crisis Management Service Orchestration. At https://ocioconnect2017.sched.com/event/CH5D/crimson-project-a-smart-cities-initiative-on-public-safety-and-crisis-management-service-orchestration

07.12.2017
Liaison Meeting with the APPS Project (ITEA3)
During the APPS - PS-CRIMSON liaison meeting partners from both projects described the essence of the innovations, uncovered the ideas and findings made during the projects, and exchanged the contact information of the relevant counter-parties.

01.10.2017
I3S Format from ESRI is Adopted as a Standard for Streaming 3D Content by OGC
The OGC (Open Geospatial Consortium) standardization body approves Community Standard for streaming 3D Content, which was initiated by Esri. The standard is referred to as the OGC Indexed 3D Scene Layer (I3S) and the Scene Layer Package Format (SLPK) Specification. These standards are released as an OGC Community Standard. More data: http://www.opengeospatial.org/pressroom/pressreleases/2639

01.09.2016
Partners from Netherlands and Canada have started the project
In September 1 2016, the Dutch and Canadian consortia launched activities on the PS-CRIMSON project. In November 8 we will have our official kick-off meeting for PS-Crimson.







Project Demonstrations

February 2020. 3D model of the Eindhoven city center integrated with video and acoustic metadata

Demonstration of the PS-CRIMSON 3D city platform for the Eindhoven city center.



February 2020. Complete Vancouver city center 3D reconstruction with layers for transportation and analytics

The final demo results of the PS-CRIMSON project on the Vancouver 3D reconstruction with layers for transportation, analytics and disaster management.



Vancouver disaster management by 3D GIS developed in PS-CRIMSON project

Demo video for Vancouver disaster management by Esri Canada 3D GIS system. All set of use-cases and applications are presented. This demo is shown at the PS-CRIMSON project review 2019.



Eindhoven demo of PS-CRIMSON project review 2019

Eindhoven demo 2019 based on the 3D models from Esri Canade and CycloMedia, integrated with dynamic surveillance data from Vinotion, Sorama and TU/e.



Integration of Dynamic Person-detection Data with 3D Rotterdam Models from Esri and CycloMedia

The video below presents the 3D model of Rotterdam obtained by merging the accurate (but not photorealistic) Esri 3D model with the photorealistic (but not accurate) CycloMedia 3D model of Rotterdam. This static model is used as a basis for visualization of live events detected by the ViNotion cameras. The cameras are equipped with AI software able to detect humans/cars and analyse human behaviour. The moving dots that you see on the 3D model are the detected humans moving in real-time.



Vancouver 3D Reconstruction and Scenario Simulation by Esri

This demo below presents the 3D reconstruction of the center of Vancouver performed by Esri Canada. The obtained model is used for multiple crisis management scenarios: analysis of flooding consequences, evaluation of earthquake impact on different city areas, etc.



Introductory Video for 3D City Modeling by CycloMedia (in Dutch)



Reconstruction of 3D City Model from LiDAR Point-cloud by CycloMedia



Combining Colored Textured Mesh with Aerial Data for 3D City Reconstruction by CycloMedia







Current Progress

Multi-sensor Setup in Eindhoven

At present, project partners are establishing a multisensor network of acoustic and visual cameras in one of the central streets of Eindhoven. The data streams from these sensors are analyzed for detection of abnormal activities (gun shots, fights, crime actions) and for pedestrian traffic analysis. The obtained real-time data is mapped onto the 3D model of the city center to increase the situational awareness of the city guards and police.


Conceptual example of the multi-sensor setup.

Vinotion Smart Camera with AI functionality

The key project partner, ViNotion, has developed a smart camera with a powerful GPU system inside the case. The main unique point is the software - based on innovative deep learning techniques, the camera is able to accurately detect and count people in real-time in most difficult conditions - occlusions, clutter and bad weather.


Smart camera from Vinotion.

Integration of 3D texturing (CycloMedia) with 3D building data (Esri Canada)

ESRI is providing structural 3D models of buildings (not photorealistic), while CycloMedia generates photorealistic 3D models (but not structurally accurate). In these experiments, we integrate the multi-modal city models together.


3D model integrated from 3D data provided by ESRI and by CycloMedia

Human re-identification in multiple cameras








       Project abstract

A key challenge faced by city operators, municipalities and political decision makers is the fragmentation of information into vertically-oriented closed systems and siloed organization models. The PSCRIMSON (Public Safety and Crisis Management Service Orchestration) project aims to overcome these challenges by delivering an integrated 3D digital model and information platform that facilitates information collection, sharing, management, analysis and dissemination from diverse public and private urban infrastructures and resources. The PSCRIMSON platform supports public authorities to improve quality and efficiency of municipal services and enhance their resilience in the presence of adverse conditions. Furthermore, adequate security and authentication methods allow selected urban data sources to be exposed to the full smart city ecosystem, which is a key enabler for the development of innovative data-driven applications and services stimulating economic activity and supporting job growth.

 

The PSCRIMSON platform will bring together the visually-oriented, intuitive nature of Geographic Information Systems (GIS) and the highly dynamic real-time contextual data streams that are made accessible through interoperable ICT-backends of public and private urban infrastructures. Augmented with 3D city models and visualization capabilities, the PSCRIMSON information platform provides unprecedented situational awareness that improves operational decision making and allows procedures and planning to be evaluated.

 

The benefits of service orchestration through the PSCRIMSON platform will be demonstrated in the context of three closely-related use cases: crisis management, public safety management and disaster management. These demonstrators will be hosted in Istanbul, Rotterdam and Vancouver.

 

With contributions from Canada, Turkey and the Netherlands, the PSCRIMSON consortium is composed of partners that cover the full market value chain of urban data providers, platform providers and application and service providers. The consortium composition carefully balances the scale and impact of large industrial partners providing and operating major urban infrastructures and platforms with the in-depth expertise of academic institutes and the innovative power of selected SMEs. Moreover, the project will actively engage with citizens and end-user organizations throughout the project to stimulate acceptance, validate scalability and optimize impact.

 

 

       Project partners

ViNotion B.V., The Netherlands


Esri Canada Limited, Canada


CycloMedia Technology B.V., The Netherlands


Eindhoven University of Technology, The Netherlands


Atos, The Netherlands


Sorama, The Netherlands


 

 

Project overview

Problem statement and market value chain

Due to rapid urbanization, it is expected that by the year 2025 2 billion people will live in an urban environment and cities will account for ~70% of economic activity worldwide. Such concentration imposes severe challenges on city administrations around the globe to support sustainable growth and ensure that cities remain attractive places for people to spend their lives in. Smart Cities employ information and communication technologies (ICT) to improve the quality, cost-efficiency and inter-activity of urban critical infrastructure and services, such as administration, education, healthcare, public safety, real estate, transportation and utilities. Whereas the rapid penetration of IoT infrastructure, mobile devices, and data-driven digital service models offers the potential for new breakthrough solutions, a key challenge faced by smart city operators, municipalities and political decision makers is the fragmentation of information into vertically-oriented closed systems and siloed organization models. The lack of common platforms, data repositories and toolsets with advanced services for the smart city is still hindering the development of an effective digital urban ecosystem. Furthermore, widespread adoption of such platforms critically depends on high standards of information security that inspires trusts from its users. To achieve this, legal, administrative and political challenges, as well as technical challenges relating to secure and reliable access to sensitive information and threat-free ubiquitous access to the internet and e-services need to be overcome.

ValueChain

Figure 1. Market Value chain

 

The PSCRIMSON project aims to bridge the above gaps and barriers by developing digital city models with integrated information platforms that facilitate data exchange between and service delivery to different city entities e.g. public authorities, businesses and citizens. Combining diverse real-time information streams with realistic city models and simulation functionality, this platform will drive the future development of cities stimulating local economic activity based on development of new data-driven services and applications and helping city operators address the huge demands associated with population growth. To inspire trust and solicit adoption, the platform will employ world-class end-to-end security and privacy mechanisms and adequate access authorization management.

Whilst the PSCRIMSON city information model is capable of creating value for public authorities, businesses and citizens across the smart city application spectrum, its capabilities will be demonstrated specifically in the context of crisis management, public safety management and decision support for event management. These use case are described in further detail in section 2.3.2 and share the following key challenges:

Complete situational awareness: Public safety and crisis management greatly benefit from bringing together different data sources to provide a complete picture of what is happening on the ground. Combined with historical datasets, full situational awareness drives analysis and supports decision makers.

Assessment of procedures and decision making models: Existing systems lack capabilities to functionally test both infrastructure and safety procedures prior to their deployment. To this end, PSCRIMSON will integrate simulation capabilities to reproduce in realistic synthetic environments the functioning of different infrastructures as well as the human behavior and interaction of people with these systems and test procedures and decision making models.

Integrated resource management and planning on the tactical and operational level: Resource management and planning are crucial issues both in day-to-day city operations as well as in severe adverse conditions. The city information model should provide specified and standardized tools that allow operations staff to manage field operations, answer questions about impact, illustrate and convey planned activities, and monitor response efforts.

The market value chain is depicted below. End-users will pay service fees for the data-driven applications and services offered to them on the basis of the urban information platform. The service providers, in turn, will have to pay subscription fees to the platform providers as well as access fees (fixed rate or per pay per use use) to data providers to receive specific information streams published on the information exchange and incorporate these in their service offerings. Finally, platform providers could demand a subscription fee to data providers for the right to publish their information stream on the urban information platform.

The international consortium consists of partners from the Netherlands, Canada and Turkey that bring together complementary core competences covering the full market value chain composed of urban data providers, platform and orchestration service providers, application and service providers and end-user organizations.

Urban data providers: Cyclomedia and TUE provide geo-referenced panoramic and aerial imagery in common GIS-formats as input to the target urban model taking the next step in transforming from 2D to 3D data provider. Information about visitor numbers, their walking patterns and behaviors, as provided by the camera-based solutions of ViNotion and incident detection algorithms as developed by TUE, rank amongst the most valuable urban information sources with applications in domains such as public safety, retail analytics and city branding. Philips Lighting focuses on leveraging the high density and ubiquitous nature of connected street lighting systems as a platform for street-level contextual data acquisition (smart poles providing power and connectivity hosting relevant sensors.) and influencing individual and collective human behavior by means of light. Enerjisa actively controls an extensive urban energy infrastructure and will enable data acquisition for energy network status monitoring based on SCADA and GIS systems that are continuously extended and updated as a part of current business activities.

Urban platform and connectivity providers: Esri Canada delivers compact geospatial capability with its expertise with the 3D smart city model based on its core ArcGIS Platform which will be integrated with related enterprise offerings and information streams. Ericsson assumes to define specification, requirements of the system architecture and development of crisis management models based on new developed privacy and security application as a service provider. Turkcell focuses on defining specifications and requirements of the system architecture and development of crisis management models giving specific data sources Elektronet aims at defining specifications and requirements of the system architecture and development of crisis management models developing smart transportation hardware and software systems based on data collection, classification and unique data templates addressed to transportation management services.

Application and service providers: ISBAK provides analytics and advisory services to the city of Istanbul for exploring integrated and innovative decision making mechanism in case of emergency. It facilitates functional and user acceptance testing of the augmented platforms at the end of the project. Esri Canada and Ericsson provide data-driven consultancy services for city planning and crisis management. Philips Lighting is developing data-driven advisory services in the public safety domain to complement its lighting products portfolio.

 

End-user organizations: PSCRIMSON will actively engage end-user organizations in the demonstration sites, such as city planners, police and emergency services, crisis coordination teams in Istanbul, Rotterdam and Vancouver. Moreover, the consortium will compose end-user sounding boards in all three domains beyond the demonstration sites themselves to validate the propositions and ensure scalability.

 

Project innovations and technology value chain

Project innovations

State-of-the-art GIS systems offer intuitive, visually-oriented interfaces to urban information sources, but typically focus on quasi-static information sources. On the other hand, emerging smart city platforms (see Section 2.3.1) are very focused on the ICT-aspects of achieving interoperable subsystems to increase the accessibility of fragmented urban data sources. However, city stakeholders, and especially those in charge with the city urbanization, lack intuitive interfaces to concretely benefit from all the urban information scattered across diverse systems.

 

The PSCRIMSON project aims to address these challenges by means of the following key innovations:

·         Open exchange of urban information streams originating from fragmented data sources (e.g., street-level crowd information, traffic data, status of municipal assets, position of emergency staff)

·         Realistic 3D city models based with access to real-time urban information streams with visually-oriented intuitive interfaces.

·         Connected street lighting systems as backbone for urban contextual data acquisition

·         Adequate authentication and privacy mechanisms based on two-step authentication on mobile devices to inspire trust and warrant privacy.

 

In the context of the use case around crisis and public safety management, these innovations will result in:

·         Intuitive real-time situational awareness of municipal services

·         Validated procedural functionalities for event, public safety and crisis management

 

 

Figure 3. Technology Value Chain

 

Technology Value Chain

The project modular architectural blocks and their dependencies are shown in Figure 3. The core architectural layers are Data Acquisition, Platform Orchestration and End-user Applications/Services with a bottom-up data flow. The Communication and Networking pillar provides a hardware infrastructure for the project development and its demonstrators.

 

The Data Acquisition layer is dedicated for collection and provisioning of real-time dynamic and static data sources, such as from the network of CCTV surveillance cameras, incident detecting sensors, GIS datasets and from 3D models of the city. The data is published for the upper layers and exposed to the applications and services via the Platform and Orchestration Layer.

The urban information platform should enable interoperability and plug-and play capabilities for data providers and data consumers based on open APIs and common information models. Moreover, the platform should also provide adequate authentication mechanisms for reliable and secure data provisioning to the applications and services located in the upper layer.

 

The platform layer exposes diverse urban information streams to the Applications and Services layer. PSCRIMSON project focuses on development of dedicated technologies/services vital for our end users in Istanbul, Rotterdam and Vancouver targeting crisis management, public safety management and disaster management. These systems provide functionality and output data to the end-users: corresponding city management departments.