Java – why is map conversion so narrow?
•
Java
I know the difference between narrow transform and wide transform of RDD My question is which parameters can prove that map and flatmap are narrow? Why are these changes not widespread? Any suggestions on RDD learning materials are appreciated
Solution
Here is one explanation
Another way to think of it is this Any row of the child RDD depends only on row 1 of the parent RDD Since each child row can point to the 1 parent row it depends on, there is a narrow dependency
The content of this article comes from the network collection of netizens. It is used as a learning reference. The copyright belongs to the original author.
THE END
二维码