Applying Artificial Intelligence in construction: Mela Works
Discover how Mela applies artificial intelligence to construction: analyse images, understand language, organise documents and manage site data more efficiently.
Applying Artificial Intelligence in construction. Although AI has potential for the sector, its use is currently practically non-existent, and only a few individual organisations are developing pioneering applications. Mela is one of them, using Artificial Intelligence for three functions: analysing images, understanding natural language and analysing complex data.
Applying Artificial Intelligence in construction
Despite the considerable potential of Artificial Intelligence, the construction sector is still at an early stage when it comes to this technology. Will we therefore have to wait years before seeing widespread use? Perhaps, but in the meantime, as exceptions to the rule, there are already organisations in the sector using it successfully.
For example, the Mela app, a pioneer in Italy, can digitalise a construction site essentially through a chat, usable on mobile devices and directly on site, as well as on a computer remotely. This brings major benefits to site management, with significant time and cost savings, but it is also essential for collecting, interpreting and organising data through artificial intelligence.
Applying Artificial Intelligence in construction: Mela
Mela applies artificial intelligence in 3 key functions: analysing and finding images, understanding and reworking the natural language of documents and messages, and analysing loosely correlated and composite data.
1. Artificial Intelligence for analysing photographs
On a construction site, a great many photographs are taken every day: to carry out inspections, report any anomalies to site managers or clients, and make work progress available remotely as well.
In this function, which is essential for site management, Artificial Intelligence comes into play in Mela through three features:
- An automatic reader of text within images, able to extract as much information as possible (for example, from documents, signs and notices). This means that all text contained in images is extracted automatically and becomes searchable information that is always available!
- An image classifier designed for construction, which currently has 100 classes, with a further 50 coming soon (for example: “foundations”, “demolition”, “external insulation”, “split air conditioner”, “reinforced concrete”).
- An image classifier with generic classes, in which 3000 classes have been identified (for example: “roads”, “buildings”, “earth”, “trees”).
2. Artificial Intelligence for finding images and data instantly
How much time do you lose searching through photographs taken on site or during an intervention for the element you need to check, such as a window or a pipe?
To make searching easier, with Mela we have created an advanced photographic archive, where you can search through all images simply by writing what you want to find. There is no need to tag the images, because the search is carried out by Artificial Intelligence directly on the images!
In the example below, we entered “earth”, and the system displays all images containing that element as the search results. In the next figure, the search instead started with the keyword “mould”.
And that is not all. The same element can be called by different names. For example, “car” can also be “motor car”, “vehicle” or “automobile”.... With Mela, we have therefore made it possible to recognise not only the classification keyword, but also semantic variations or synonyms.
To return the image that is as close as possible to what the user is looking for, we use another neural network capable of interpreting language.
In the image below, you can see the result of a search in Mela based on three keywords referring to the same thing.
3. Photographing delivery notes or floor plans and extracting structured text. A dream made reality with Mela!
That is right: with Mela, you can photograph a delivery note and upload it to the app directly on site using a smartphone, then already have all cost items in table format! The time required? Just one click!
Our Artificial Intelligence programme can intelligently read text from photographs of documents such as delivery notes, floor plans and invoices, and structure it into documents.
If you search for the name of your materials supplier, with Mela you will not only get, with one click, all the photographed delivery notes containing the name you searched for, but also their document contents in the right format (for example, in Excel), ready to be sent to the accountant in real time and with zero effort!
4. Artificial intelligence for automatically transcribing a voice note
Nobody wants or has time to write the Divine Comedy of the construction site, but it is often necessary to update your team with lengthy information and complex descriptions. Our Artificial Intelligence programme makes this possible: with Mela, you can send a voice note with automatic transcription in the chat, which can also be included in reports.
5. A participatory system with our customers—and one that is constantly evolving
If our customers need to classify images according to specific requirements, they can contact us and ask us to add the Artificial Intelligence classes they are interested in. Are you specialised in installing and maintaining renewable energy systems and do you need to find all images of “photovoltaic panel inverters”? Simply ask Mela, and it will add the term to its Artificial Intelligence system.