Platform of Trust is now implementing Connector version 2 (V2) Architecture that, in addition to traditional request-response data, would add capabilities to get streaming data whenever it is available.
A webinar was organized on 10th September for a sneak peak of the new connector V2 architecture that is going to be released in January 2021. Platform of trust, demonstrated the new Platform architecture, capabilities of new data products and how it is going to impact the overall development in Connector Engine.
So far, all connectors in Platform of Trust have been implemented using request-response logic. During the summer 2020, Platform of Trust did a small Proof of Concept (PoC) implementation of V2 connector which enables streaming data products for the customers. This PoC was built together with Zure (Architectural and DevOps support) and our partner Polku Innovations. Development adjusts the current architecture to include the needed capability for streaming data products.
In this PoC data was gathered from Haltian streaming IoT platform to Platform of Trust Azure. From there it was streamed to Microsoft PowerBI.
Under Connector V2 architecture, overall functionalities are split between independent (but light-weight) micro-services.
- The connector microservice would be responsible to get data requests from the client via service-bus, send it to the intended data source and retrieve the raw data sent.
- The transformer microservice is intended to change the raw data into a harmonized format.
- The service-bus is a bridge between connector, transformer services, and the API management moderating Platform of Trust APIs. The service bus forwards initial data requests to the connector during the request cycle. When harmonized data is available, the service bus forwards it, along with a session-based message, to the specific service (here, application APIs in the Platform) that originally requested for data. The response is sent back to the client.
V2 architecture development has been approved and started in our current product increment using SAFe agile framework. 80% of the connectors developed Q4 forward will be based on V2 architecture. We expect the customers to onboard to the V2 architecture on January 2021 the latest. In the mean while business critical connectors are developed for customers also in V1 architecture.
Chief Development Officer