https://issues.apache.org/jira/browse/SPARK-14220 is resolved now.
Last week, I (Darcy Shen) contribute some time for the migration.
Now, the last failing unit test has been fixed.
And this PR (https://github.com/scala/scala/pull/7156) is for the migration. Spark SQL’s Row uses WrappedArray, as a result, the bug affects the correctness of the equality of Row.
@ghawkins the stating: http://apache-spark-developers-list.1001551.n3.nabble.com/code-freeze-and-branch-cut-for-Apache-Spark-2-4-tt24365.html#a24839