Last week I attended Big Data Spain (BDS), a renowned event focused particularly on Big Data, Artificial Intelligence and Machine Learning. It’s a reference event about Big Data, not only in Spain but across Europe. The event is almost entirely held in English and attracts top level speakers and public.
I couldn’t take a lot of notes, but I’ll summarize the talks that deserve your attention (among those that I heard):
The first keynote was the typical inspirational talk to open an event. Óscar focused on the growing relevance of Big Data and Artificial Intelligence. It’d be curious to compare it with the opening keynote from previous years, the revolution is always just around the corner.
Anyway, Óscar gave some interesting concepts. I specially liked the way he explained the next relevant disruptions:
- First disruption, use big data also for Operational purposes (and this is the key, IMHO)
- Second disruption, use distributed applications via microservices
- Third disruption, smart data centers moving first to IaaS and then to PaaS
Big Data, Analytics, and Tax Fraud - José Borja Tomé (Agencia Tributaria)
José Borja started with the disclaimer “As you can imagine, I’m not here to show you how to pay less taxes”, and just with that he got all my attention and friendship. He also explained, for the greater tranquility of the Spanish audience, that Agencia Tributaria (the Spanish Tax Agency) is trying to modernize itself in terms of combating fraud and help the tax payers fill in the required forms. He delivered this messages with some slides that looked like they were made with Office 95 but the important thing is the content, not the appearance.
He ended his talk with several surprising and exciting figures. For example, and according to his own figures, Spain performs better (despite our usual perception) than the EU-27 median regarding the difference between the VAT that should be payed and the one that is really payed.
Big Data security: Facing the challenge, by Carlos Gomez (Stratio)
Carlos gave a technical overview of how to protecting the data and services of a company in a Big Data environment when everything is data-centric. He summarized that it is distributed in two areas: protect the data and protect the service. You should review this talk if you are in the security business.
Holden gave several good tips and tricks about Apache Spark in general, and specifically about using it from outside the Java ecosystem in Python. As a Python connoisseur, but not a Spark user (yet), I just learned a couple of usable tips but the talk was great anyway and it was a pleasure to meet Holden.
This talk was one of the most promising for me after reviewing the schedule a couple of days before the event. Several years ago there were rumours of the death of causal inference at the hands of Big Data. The main reasons why Big Data might have done it are:
- Humans are bad at coming up with causal hypotheses
- Correlational models form a more accurate picture of reality
- Data analysis just seems to be headed towards the correlational approach
According to the speaker, causal inference is today more relevant than it’s ever been. In fact, bigger data normally implies a better causal inference and not the opposite. Also, Big Data findings can inspire causal hypotheses and Machine Learning methods can help us to estimate causal quantities.
I probably will watch again this talk if the video is published.
Another of my favorite talks of this BDS, and very difficult to summarize. Nikolay reviewed where deep learning currently stands, what are the current limitations and challenges, and how neuroscience and psychology can bring us closer to human-level intelligence (or even beyond).
Tyler based his session on a very simple but interesting concept: “Tables are data at rest, Streams are data in motion”. He explained why it’s important to know perfectly the status of the data at each stage, and how to make the most of both data structures mastering the operations and transformations between streams and tables.
This was a surprisingly interesting talk, despite I entered the room with very low expectations. In summary, Sean emphasized the necessity to think about errors, to prevent them and to estimate the uncertainty based on the fact that there will always be errors. He gave several examples and some useful tips and tricks.
this session was very funny and interesting. Michael summarized the current ecosystem regarding AI in VR, explained the current approaches to AI (and the pros and cons of each) and even made some predictions about what will happen in the future. As Director of Product of IBM Watson, he presented as an example Star Trek: Bridge Crew, an amazing VR game that reacts not only to the player movements but also to voice commands. I’ll just leave you with the trailer:
My last choice could not be other than my colleague David. He explained what we are building in ING to be used by any business unit around the world. It was only a short talk, but David could have spent hours talking about the project transmitting the passion he has for this.
In summary, what ING is building is an event-driven architecture delivered as one platform, with Apache Kafka, Apache Flink and SAS RTDM in the core. I hope that you’ll listen more about this in the future.
It was my second or third presence in Big Data Spain. I attended a couple of years between 2012 and 2014, but I ceased attending because the content seemed too focused on marketing and business. This year I have finished (again) with a similar feeling, but at least some of the sessions were worth the visit. Anyway, the event itself is much more professional than in the past and everything looked controlled and very well organized. I’ll consider attending again next year.