jdhao's digital space
Recent content on jdhao's digital space
马上订阅 jdhao's digital space RSS 更新: https://jdhao.github.io/index.xml
LATERAL VIEW EXPLODE in Spark
2023年9月26日 12:58
For array type column, explode() will convert it to n rows, where n is the number of elements in the array.
For map/dictionary type column, explode() will convert it to nx2 shape, i.e., n rows, 2 columns (for key and value).