Community Post

Digital Transformation at GRANTECAN


Large telescopes such as Gran Telescopio Canarias, hereafter GRANTECAN, are complex machines, with massive optics and mechanics tuned to nanometre precision, thousands of moving axes, extreme cryogenic systems, varied electronics and sensors, all managed by a sophisticated control software. One can therefore see GRANTECAN as a 24/7/365 factory with complex machinery, without forgetting that its (intangible) products are not physical assets, but knowledge about the Universe.

As a state-of-the-art factory, at GRANTECAN we are in the process to transform our operational model according to the paradigm of the so-called Industry 4.0.

The basic ingredient of Industry 4.0 is digital transformation aimed to optimize and accelerate business and production processes. Powerful digital enablers of industry 4.0 is the panoply of connected sensors that are grouped under the umbrella of Internet Of Things (IoT, note that 40 billion connected IoT devices are forecasted in the world by the end of 2023!), as well as robots, cobots, drones, machine’s sensors, and the corresponding huge flow of data  which is to be analyzed using Artificial Intelligence, Big Data technologies, etc, to feed diagnostics and prescriptions back to the operational processes.

At GRANTECAN, an additional important goal is the empowerment of our workers, facilitating their tasks, removing repetitive activities, providing high-level digital tools, in other words providing opportunities to develop their talent and expertise. This fits the next-level of the present industrial revolution, in which this transformation aims to be human-centric and with the explicit goal to preserve our planet (Industry 5.0).

The digital transformation at GRANTECAN is described in the illustration below, where all different agents considered so far are listed. As it is a scalable process that allows the inclusion of heterogenous information, in the future other operational and scientific aspects will be considered.

At the tip-of-the-iceberg of this technological effort (the Enterprise layer in the illustration above), we have been seeking for an innovative, attractive user interface. TouchDesigner, that we used in the past for outreach activities, was our choice, knowing its versatility to treat nearly any kind of data, wide interoperability, and in particular its capability to provide real-time renderization 3D models. The nature of TouchDesigner, principally devised to create artistic products, allows a much more versatile, dynamical, visually attractive, and user-friendly approach as compared to the standard “engineering” panels that are generally used to visualize factory’s data. Our goal was to build an effective way to display the real-time status of the telescope and the installation, informing people in charge of the installation of status changes, faults and emergencies, security issues, the environmental conditions that may allow or not the astronomical observation, and the most relevant operational data.

Using the glossary of industry 4.0 (but we did not know it when we started!), we have been building a digital twin of GRANTECAN. There is still no complete consensus on the exact definition of a digital twin, as it is a relatively new concept, but the main idea is that a digital twin is a virtual copy of a physical entity (a building, a factory, a machine, a person), which is fed with real data that can be analyzed in the virtual space, providing informative feedback to the real entity that facilitates its operation, maintenance, and development. The “technology” of digital twins is very rapidly growing, as part of the digital transformation of industries. It can therefore be considered another essential digital enabler of the transformation to Industry 4.0.  Can TouchDesigner enter the whole game of digital twins (see for example the Digital Twin Consortium) as a competitive solution? I do not know the answer in general, but for GRANTECAN we are certainly achieving a successful solution, with the added value in terms of creativity and aesthetics that provides a platform originally devised for different ecosystems (art, entertainment, branding,..) such as TouchDesigner.

In a first phase, a 3D model of the whole GRANTECAN installation (telescope and annexed buildings) has been ingested into TouchDesigner and system’s parameters can now be visualized in nearly-real-time on the top of the 3D model using customizable views, controlled using a multi-touch control monitor. The output is presented in a large display in the telescope’s control room. Other panels were build, a dashboard with general information about specific subsystems, and an interactive display of the various optical and infrared surveillance cameras distributed throughout the installation.

This development was done by y=f(x) with the assistance of GRANTECAN engineers. At the beginning it was a bit of challenging, as two different worlds (art and science engineering) were meeting and had to talk the same language and adapt “on-the-fly” the scope of the development, the timing and the working methodology. Instrumental to this scope was a visit of Roy, Tim, Darien, and Rogier from FXLAB to our installation at the Observatorio del Roque de los Muchachos at the top of the island of La Palma (Canary Islands, Spain). After a quick adaptation, it was really a pleasure to work with YFXLAB, at GRANTECAN we not only appreciate their enormous competence and skills, but also their availability to adapt to our idiosyncrasies (e.g. continuous adaptation of the planification to fit operational incidences, delays in the supplies of the necessary hardware, ..), and above all a cordiality that makes this project fully enjoyable.

Project continues, but even at its present stage feedback is enthusiastic from nearly any people who have seen it at work: our technicians, engineers, and astronomers, the general public, collaborating technological companies, other telescopes, and even the world leading companies in the development of digital twins, when we showed them some samples at the IoT Solutions World Congress in Barcelona on February 2023.

We are now in the definition of the next phases of the collaboration with YFXLAB. What has been done so far discloses so many possible developments (some of them extending to the outreach of GRANTECAN to the general public) that we are making the effort to understand in which ones TouchDesigner provides unique, most valuable solutions.

Derivative: What was the objective when you were considering bringing TouchDesigner into the project? We understood it was to radically improve the visualization of the state of the entire telescope facility.  For the purpose of (1) improving productivity of the engineers, and (2) giving the public a better understanding of how the telescope facility functions on a day-to-day basis.

Romano Corradi: You can pick up what you find of more interest in my (lengthy) description above.

Derivative: You’ve put a lot of effort into gathering and centralizing data into the FIWARE data center and IoT cloud system. Can you give us some specific examples of the data gathered?

Romano Corradi: As first step of the project, development was focussed on conveying into FIWARE environmental information (meteo, air quality, visual inspection of sky conditions), security aspects (presence of people in critical areas), the monitoring of services such as the photovoltaic energy production and its use by electric cars, the water consumption, as well as basic information for the night operation in terms of the telescope position, temperature of its structure, path of the light through the different mirrors and to the science instruments, and the instruments status.

Derivative: Can you give some examples of how that data is massaged in FIWARE to make it more useful to the engineers.

Romano Corradi: So far, FIWARE collect real-time information, which is then visualized either using the GRAPHANA software to produce specific “engineering” views, or by TouchDesigner which provides a more general, comprehensive, and immediate view easy to understand by any type of user.

Derivative: TouchDesigner then has a simple protocol/API to obtain massaged or raw sensor data from FIWARE.  Is the data you are receiving all expressed in JSON?

Romano Corradi: y=f(x) would better explain this.

Derivative: I suppose a major challenge is to show the various bits of data in the clearest way possible to the viewer. What are your thoughts on the approach you took?  It seems like you chose a monocolor coloring except for the data that you want to enunciate, for example.

Romano Corradi: y=f(x) would better explain this.

Derivative: You said that currently, you are focused on using snapshots of data at the current time. But to understand it better you need to look at how the data changes over time. What are your plans in that regard?

Romano Corradi: Next step of the development of the project will be to process data to determine the evolution of the operational processes, to automatize and optimize them, predict and act against failures, and avoid human errors. This will be done by applying different kind of analysis methods, including machine learning, as an intermediate layer before visualization is done with either Graphana or TouchDesigner.

Derivative: Give us one example where that would be useful (that you may implement first).

Romano Corradi: A critical parameter for a telescope such as GRANTECAN is to maximize the image quality (sharpness of the observations of stars and galaxies). This depends on the status of telescope’s mirrors and their mutual alignment (only the primary mirror has 326 degree of freedom which have to be adjusted in real time), the continuous cleaning process of mirrors, the mechanical performance of the telescope (which needs to move with the highest precision to follow the apparent rotation of the night sky), but also the ventilation of the dome to minimize air turbulence, which is controlled by a complex natural and forced ventilation in the dome. Putting together real-time information on all these aspects, analyzing them, and providing an immediate and clear visualization for the use of the night operators is one of goals of the project.

Derivative: You said already the engineers have been able to get almost instantaneous alerts whereas before that data may have been buried in a sea of numbers. Can you give an example of that?

Romano Corradi: The telescope structure is good example, as it contains a large number of temperature sensors, which are now immediately visualized in the interactive 3D model, which allow to understand where the alert occurs and act accordingly. This was not possible before, as data were stores in a dynamic table where the precise location of the sensor was not obvious.

Derivative: You talked a bit about the expanding the data gathered to include energy use and production, and vegetation information. Have you taken some steps to integrate that, and look at some of the data?

Romano Corradi: Global electricity consumption, photovoltaic production, and use of the electricity by our e-cars are already monitored by the system. Next step would be to differentiate in detail the energy consumption by each telescope’s subsystem, to understand the most efficient energy saving options.

Derivative: Then what questions will you be asking, or what will you look to be optimizing with that extra environmental data?

Romano Corradi: It is crucial to predict in advance the expected “optical” quality of the night in order to plan accordingly the scientific programmes to be executed. This includes the evolution of temperature, humidity, wind intensity and direction, air turbulence and dust content, and moonlight. As weather can change very quickly in the mountain, we need to be able to react quickly by closing the dome of the telescope to prevent any damage by wind, or even simple condensation of water onto its optical surfaces.

Derivative: How did you get the model of the facility (where did it come from), what file format, and what did you do to it when you got it to make it more useful?

Romano Corradi: y=f(x) would better explain this.