Testing in data engineering

Data engineering is the discipline involved in laying pipes between different data stores. The data is read, converted, and put in different places. It's not just "data", it's "big data". What's big? No one knows. But it's cool and complicated. And the main thing is — how to test it? You're not going to run terabytes of data in tests, will you? Pasha and Ksyusha will tell and show. They will also explain approaches to how the complexity can be reduced.