[SPARK-35357][GRAPHX] Allow to turn off the normalization applied by static PageRank utilities

[ebonnal]

What changes were proposed in this pull request?

Overload methods PageRank.runWithOptions and PageRank.runWithOptionsWithPreviousPageRank (not to break any user-facing signature) with a normalized parameter that describes "whether or not to normalize the rank sum".

Why are the changes needed?

https://issues.apache.org/jira/browse/SPARK-35357

When dealing with a non negligible proportion of sinks in a graph, algorithm based on incremental update of ranks can get a precision gain for free if they are allowed to manipulate non normalized ranks.

Does this PR introduce any user-facing change?

No

How was this patch tested?

By adding a unit test that verifies that (even when dealing with a graph containing a sink) we end up with the same result for both these scenarios:
a)

• Run 6 iterations of pagerank in a row using PageRank.runWithOptions with normalization enabled

b)

• Run 2 iterations using PageRank.runWithOptions with normalization disabled
• Resume from the preRankGraph1 and run 2 more iterations using PageRank.runWithOptionsWithPreviousPageRank with normalization disabled
• Finally resume from the preRankGraph2 and run 2 more iterations using PageRank.runWithOptionsWithPreviousPageRank with normalization enabled

[HyukjinKwon]

ok to test

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42856/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42856/

[SparkQA]

Test build #138334 has finished for PR 32485 at commit 60482b3.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[HyukjinKwon]

I think it's fine. cc @srowen FYI

[srowen]

Looks OK, only one tiny comment about 'since'

[SparkQA]

Test build #138375 has finished for PR 32485 at commit 5a52408.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[ebonnal]

Thank you @Ayushsunny @HyukjinKwon @srowen for the review 🙏 .
I have applied the requested changes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42898/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42898/

[srowen]

Merged to master