Abstract
Here we study and compare nonlocal diffusion processes on networks based on two different kinds of Laplacian operators. We prove that a nonlocal diffusion process on a network based on the path Laplacian operator always converges faster than the standard diffusion. The nonlocal diffusion based on the fractional powers of the graph Laplacian frequently converges slower than the local process. Additionally, the path-based diffusion always displays smaller average commute time and better diffusive efficiency than the local diffusive process. On the contrary, the fractional diffusion frequently has longer commute times and worse diffusive efficiency than the standard diffusion process. Another difference between the two processes is related to the way in which they operate the diffusion through the nodes and edges of the graph. The fractional diffusion occurs in a backtracking way, which may left the diffusive particle trapped just behind obstacles in the nodes of the graph, such as a weighted self-loop. The path-diffusion operates in a non-backtracking way, which may represent through-space jumps that avoids such obstacles. We show that the fractional Laplacian cannot differentiate between three classes of brain cellular tissues corresponding to healthy, inflamed and glioma samples. The path Laplacian diffusive distance correctly classifies 100% of the mentioned samples. These results illuminates about the potential areas of applications of both kinds of nonlocal operators on networks.

Original content from this work may be used under the terms of the Creative Commons Attribution 4.0 licence. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.
1. Introduction
Nonlocal interactions are ubiquitous in many physical and biological systems [1–5]. In general, the term 'nonlocal' is applied for large systems of interacting particles where a single particle can interact not only with its nearest neighbors but also with particles far away [6]. Many of these systems can be represented as networks in which the nodes describe the physical or biological entities and the edges represent their interactions [7–9]. Caution should be taken here to consider nonlocal interactions in network setting. Once two nodes are connected by an edge their interaction is considered to be local, although they can be geometrically separated at a long distance. Therefore, the nonlocal interaction in a network refers to the cases where a node 'feels' the influence of another which is not connected to it in the network. Such systems can be useful to represent for instance, swarms of insects, flocks of birds, schools of fish or colonies of bacteria in biology [3, 4], or the atoms/molecules adsorbed on the surface of metals, cold atomic clouds, natural light-harvesting complexes, helium Rydberg atoms, and cold Rydberg gases in physics [10]. All of them display long-range interactions of nonlocal character, which could display features that are not often observed in other systems, such as broken ergodicity and long-standing out-of-equilibrium regimes [11].
From a mathematical point of view these nonlocal behaviors are captured by nonlocal operators. In particular, for diffusion-like processes the fractional Laplacian [12] is frequently used. It can be represented by a singular integral in real space :
where , 0 < s < 1 and with as the gamma function. The nonlocal notion of derivative in the graph setting can be written as [13]:
where is a positive measure defined between the nodes x and y. In this framework, Estrada [14–16] proposed the path Laplacian operators for graphs which reads as
where is the shortest path distance between the two nodes and 0 ⩽ s ⩽ ∞ is the nonlocal parameter. The sum is carried out for all pairs of nodes which are at exactly the distance d from each other.
Another definition of the fractional Laplacian in the continuous setting is based on the spectrum of the operator [12]. In this case
where λk and ϕk are the eigenvalues and eigenvectors of −△, Ω is a bounded Lipschitz domain, , denotes the inner product in the L2 Hilbert space, and 0 < α < 1. An adaptation of this definition to the case of the graph Laplacian was conducted by Riascos and Mateos [17, 18]. They defined the 'fractional' graph Laplacian as the fractional powers of the graph Laplacian , where U is the matrix of orthonormalized eigenvectors and Λ the diagonal matrix of eigenvalues of the graph Laplacian [30–33]. Here , where K is a diagonal matrix of node degrees and A is the adjacency matrix of the graph.
So far the two approaches, the path Laplacians [14–16] and the fractional powers of the graph Laplacian [17, 18] (hereafter the fractional Laplacian) have grown independently in the literature. The first mainly in the mathematics and applications literature [19–24] and the second in the physics one [25–29]. However, there has not been a comparison between the two approaches that clarifies their physical meaning and areas of potential applicability. This is particularly true for the case of the fractional Laplacian for which no physical meaning, apart from its involvement in nonlocal random walks, has been given. In the case of the path Laplacian it is clear that the operator accounts for the hops of a diffusive particle between pairs of nodes of a graph with probabilities that decays as a function of the distance between the nodes. However, such interpretation does not exist, in a physical sense, for the spectral fractional graph Laplacian. For instance, for this operator we do not understand which law governs the particle hop between nodes, or how the fractional parameter influences the strength of the nonlocal over the local process.
Here we investigate both nonlocal Laplacian operators for networks. We focus in particular on their use in the graph nonlocal diffusion equation. We prove here that such nonlocal diffusion always converges faster when the path Laplacian is used than with the use of the local (standard) graph Laplacian. However, in the case of the fractional Laplacian the nonlocal diffusion converges slower than the local process if the algebraic connectivity of the graph is not smaller than one. We found that a nonlocal diffusive process controlled by the fractional Laplacian cannot overcome obstacles in the graph, such as a weighted self-loop at one node with a very high weight. On the contrary, we show here that such obstacle can be avoided via the through-space navigation used by the path Laplacian. We explain here why these situations occurs by finding a physical meaning for the nature of the diffusive processes controlled by these two operators on graphs. We also prove that the fractional Laplacian has longer commute times and worse diffusive efficiency than the standard diffusion process. As proved here, the path Laplacian always produces smaller commute times and better diffusive efficiencies than the standard Laplacian. Finally, we apply the two Laplacians to study the classification of brain cellular samples corresponding to healthy, inflamed and glioma tissues. We show that the fractional Laplacian cannot differentiate between the three classes while the path Laplacian diffusive distance is capable of correctly classifying 100% of the samples. We give a plausible explanation of the biological process possibly occurring in these three different kinds of cellular tissues.
2. d-path Laplacian operators
Let us fix any α with 0 < α ⩽ ∞ and let us define the matrix for all i, j = 1, ..., n. Let be a real function on the open interval . We define the pseudo-entrywise (pseudo-Hadamard) matrix function as
Let be the shortest path distance matrix of the network G [9]. Then, let us define the pseudo-entrywise matrix functions of D as .
Here, the function f could be an exponential, a trigonometric function or simply the power function. Let us hereafter focus only on the negative power function, such that if represents the entrywise power we define where
It can be seen that is a generalized adjacency matrix from the fact that: . Let us now define the generalized node degree matrix as
Therefore, we can define
as a generalization of the graph Laplacian matrix. This generalization considers the nonlocal interaction between a pair of nodes through a shortest path connecting them. For instance, the path Laplacian of a linear chain of 4 nodes labeled as 1–2–3–4 is:
which indicates that the pairs of connected nodes in the graph interacts locally with 'strength' equal to one, and additionally the pairs and interact through nonlocal interactions with 'strength' 2−s , while the pair interacts nonlocally with 'strength' 3−s . We can express these 'strength' in terms of probabilities by defining the transition matrix of the embedded Markov chain related to (for reviews about random walks on graphs see [34–36] and for its connection with diffusion on networks see [37]). That is,
Therefore, the probability that in the previous example a particle at node 1 at time t hops to node 2 at time t + 1 is , while for hopping to node 3 it is , and to node 4 it is . If s = 2 these probabilities are approx. 0.735, 0.184 and 0.082, indicating that the local hopping is more probable than that to a second neighbor and much more probable than to a third neighbor.
We can write down now the conservative equation of a diffusion process taking place on the nodes and edges of the network. Namely, if is the diffusion coefficient [14–16], we have
with initial condition . The solution of (2.7) is given by
We will consider hereafter for the sake of simplicity. The path time-evolution (path heat kernel) appearing in the solution of the path diffusion equation can be expressed as
where and are the jth column of and of , respectively, and 0 = μ1 < μ2 ⩽⋯⩽ μn . Then, we have
where . Let us take , such that we have
Because makes the largest contribution to among all the nonzero eigenvalues of , it dictates the rate of convergence of the diffusion process.
The following result has not been previously noticed in the literature about the path Laplacians of graphs. Let be a simple connected graph different from the complete graph. Let be the path Laplacian of G. Then, is the adjacency matrix of a weighted complete graph . It is known that the algebraic connectivity [39–41] is a nondecreasing function of each edge weight [38]. Then, if we reduce the weights of the edges the algebraic connectivity will not increase. We have seen that , which corresponds to the algebraic connectivity of the network [39–41], therefore as s → ∞ implies reducing the edge weights we have that
This result implies that a diffusive process controlled by the path Laplacian never converges at a slower rate than a similar process controlled by the local Laplacian. Also important is the fact that as we increase the nonlocal effect in a graph by reducing s, we are accelerating the convergence of the process. That is, a diffusion on a graph will converge faster when s = 2 than when s = 4, where the first represents a stronger long-range (nonlocal) interactions.
Finally, note that both processes converges to each other when s → ∞, i.e. when no nonlocal interactions are taken into account:
2.1. General properties of the path Laplacians
From a physical point of view we should obtain the Laplacian from the divergence of the gradient of a function defined on the set of nodes of the graph. Then, let us define such a path gradient matrix, , of a connected graph of n nodes, where . Let li,j be a shortest path of length dij connecting the nodes i and j. Let us replace the shortest path li,j by an arbitrarily directed edge . Let e has a weight . Then,
It is straightforward to realize that, as desired:
Let ℓ2(V) be the Hilbert space of functions on V with inner product (see [4, 42])
The path Laplacian is then defined as the following operator in ℓ2(V)
When s → ∞ it transforms into
which is the definition of the standard Laplacian.
Finally, let us define the following matrices where
where δd (v) is the d-path degree of a vertex v ∈ V:
Obviously, . Then, can be written as
where △ is the diameter of the graph. This last formulation allows us to introduce a subtle but important modification. That is, we can make the nonlocal parameter s also dependent on the shortest-path distance separating the interacting nodes. In this case we have
where sd is any real function on d. Suppose, for instance, that we need to eliminate the hopping between nodes at a given shortest path distance equal to ζ, while the rest of interactions decay as d−2. We can then use:
3. Fractional powers of the graph Laplacian
Riascos and Mateos [17, 18] considered the fractional powers of the Laplacian matrix Lα as an operator for describing nonlocal interactions on graphs. The fractional powers of the Laplacian matrix can be defined by using the following integral [43]:
In practice it can be obtained through the spectral decomposition of the Laplacian as: . They considered the 'fractional' diffusion equation of a graph G to be [17, 18]:
whose solution is given by . Similar as we did for the case of path diffusion equation we can express the fractional time-evolution (fractional heat kernel) as
where ψj and φj are the jth column of and of , respectively. Following a similar procedure as before we can show that the process converges and that dictates the rate of convergence of the diffusion process. This indicates that the larger the value of the first nonzero eigenvalue of the faster the convergence of the diffusive process.
Let us then show a result that has not been previously discussed in the literature about the fractional powers of the Laplacian matrix. Let G be a graph having then indicating that the fractional diffusive process will converge more slowly than the local diffusive one. Let us consider, for instance, an Erdős–Rényi random graph , i.e. a random graph with n nodes and linking probability p [44]. Then,
which converges in probability as n → ∞ [45]. For an Erdős–Rényi random graph to be connected it is necessary that pn > 1 [44], which immediately implies that for any value of α. It should be noticed that even in the case of the convergence could be slower using the fractional Laplacian than using the local one. But this indicator of serves to guarantee that at least in a few graphs the convergence of the fractional process is slower than the local one.
Here again we can obtain an embedded Markov chain whose transition matrix is given by
Because we can write for v ≠ w as
and zero for the main diagonal entries.
4. Comparing path Laplacians and fractional graph Laplacians
4.1. The 'power series' representations
We first start by analysis of the operator . We will focus here on for the sake of simplicity. Because (it is positive semi-definite) we have that , which implies that . Therefore we can write
The term can be written as , where B = I − K and A is the adjacency matrix. Then, it is clear that the power-series expansion of contains a sum of powers of the adjacency matrix. The entries of these powers of the adjacency matrix are interpreted as follow. The term counts the number of walks of length k between the nodes v and w of G. A walk of length k in G is a set of nodes i1, i2, ..., ik , ik+1 such that for all 1 ⩽ l ⩽ k, (il , il+1) ∈ E. A closed walk is a walk for which i1 = ik+1. Therefore, a particle diffusing on G as described by is hopping back and forth between two nodes before it arrives at its destination. Let us consider the term as an illustration. This term can be written as
Let us focus only on the term A2 (the rest will be analyzed later on). Here, counts the number of backtracking (closed) walks of length 2 starting (and ending) at the node v. The term is the only one accounting for a nonlocal interaction, as it describes the hops from a node v to a node w two edges apart from v.
Let us now move to the path-Laplacian operators. In order to express the path Laplacian matrix in terms of powers of the adjacency matrix we need to use a different kind of algebra. We define it as follows. Let be the min tropical semiring with the operations [46–48]:
The identity element for ⊕ is +∞ and that for ⊗ is 0. Then, we can define the tropical adjacency matrix power as
where , which is the tropical identity matrix, i.e. a matrix with zeros in the main diagonal and ∞ outside it.
We can now write the path Laplacian in terms of tropical powers of the adjacency matrix as:
where represents the pseudo-Hadamard fractional powers of the corresponding matrix. The tropical sum is carried out up to infinity as it converges in all cases where there are no negative cycles in the graph. A negative cycle is a cycle where the product of the weights of all its edges is negative. Typically, except for signed graphs, we consider positive edge weights, which always avoid such negative cycles. The infinite sum is known as the Kleene star operator of A [46–48].
Therefore, the path Laplacians are based on the pseudo-Hadamard fractional powers of the tropical power-series (Kleene star) of the adjacency matrix. Let us recall that a path is a walk with no repeated nodes and edges. This means that accounts for nonbacktracking walks of minimum length, i.e. shortest paths, between the corresponding pairs of nodes. In contrast, Lα accounts for backtracking walks of any length between the pairs of nodes.
4.2. Backtracking vs non-backtracking nonlocal diffusion
To start our comparison here we will focus on the complete graph Kn with n nodes. In this case, the fractional powers of the Laplacian can be written as
This means that the fractional powers of the Laplacian of a complete graph changes with the strength of the long-range interactions, although such nonlocal interactions do not exist in Kn , i.e. a diffusive particle in Kn can only jump to nearest neighbors. To be clearer, let (it is the same to start the process from any other node as all are equivalent). Then,
Obviously , which means that the local and the nonlocal versions of the same model are different for a complete graph.
The difference of particle concentrations between the node 1 and any other node is . Therefore, when α = 1 and n is sufficiently large, this difference is very close to zero. For instance, for only n = 10 nodes the particle concentration at the starting point is 0.100 04, and at any other node it is 0.099 99 at t = 1. However, if α ≪ 1 the difference of concentrations is significantly more marked between the starting point and any other node. For instance, for the same graph as before with α = 0.25 the concentrations are 0.2520 in the starting point and 0.0831 at any other node at t = 1. This means that at the same time there is significantly higher concentration at the initial point than at the rest of the nodes. It is like if the particles were retained at the starting point and slowly propagate to the rest of the graph.
In order to understand the physical process that the fractional Laplacian produce when used in the graph diffusion equation we proceed by discretizing the time of the process. Let i be a node of the network and let > 0 be the step size. Then, the standard graph diffusive process can be written in terms of the discrete time k as [49]
In matrix-vector form it is written as
where is the Perron matrix [49]. We then generalize this process to include the fractional Laplacian and the path-Laplacians by using and , respectively. The values of the time step are where Ξ is the maximum of all diagonal entries of the corresponding Laplacian, i.e. , and , respectively. For the sake of the current analysis we use α = 1/2 and s = 2.
In figures 1(a)–(c) we illustrate the discrete time evolution of diffusive processes with the three Laplacians considered, i.e. , and , in a linear chain of three nodes. The standard diffusive process (figure 1(a)) using , proceeds as follows. At time zero all the particle concentration is at node 1 (blue bar). At time t = 1, part of this concentration is transferred to node 2, while the rest remains at the node 1. Then, at time t = 2 some concentration is transferred from node 2 to 3, while node 1 again transfers some concentration to node 2. The process continues in a similar fashion until equilibration. The main difference with the two nonlocal processes is that, in the last one at t = 1 node 1 transfers simultaneously some concentration to nodes 2 and 3. In the process with the fractional Laplacian it seems like if less concentration is transferred from node 1 to nodes 2 and 3, in relation to the process controlled by . The consequence of this difference is that the process controlled by the path-Laplacian arrives at equilibration faster than that controlled by . It seems like if this were only a quantitative difference, but let us explore a complete graph to see whether these differences are also in the kind of mechanism behind these processes. In the
Figure 1. Bar plots of the state (concentration) of a diffusive particle at the different nodes of a linear chain with 3 nodes (a)–(c) and in a triangle (d)–(f). The plots correspond to the use of the three different Laplacian (a), (d), (b), (e) and (c), (f). In all cases we use α = 1/2 and s = 2.
Download figure:
Standard image High-resolution imageWe now consider the evolution of the three diffusive processes in a triangle graph (figures 1(d)–(f)). In the
To understand what is happening we should go back to the Taylor series expansion of the fractional powers of . Here again we focus on the particular case of for the sake of simplicity. As we have seen the power contains the terms I + K2 + A2 − KA − AK. The terms accounts for closed walks of length two retaining the diffusive particle at the node v. The terms , accounts for the movement of the diffusive particle from v to w, but just in case that the two nodes are connected. That is, this term only accounts for a local hop of the diffusive particle from one node to its nearest neighbors. Consequently, all the terms and , are just trapping the particle either at the origin (node v) or at its closest environment, i.e. its nearest neighbors. Only the term moves the particle nonlocally. This situation resembles a particle that departs a node and bounces back and forth before reaching its steady state. In the case of a complete graph like the triangle illustrated in figure 1(e), the particle departs from the origin node and visits all its nearest neighbors, but then it rebounds back to the origin where it is retained for a while. The backtracking diffusive process continues until equilibration is reached. On the contrary, in the process controlled by the path-Laplacian the diffusive particle departs from the origin and arrives at every nearest neighbor without bouncing back to the origin. This implies the equilibrium in just one step. As we will see this difference between backtracking and non-backtracking diffusion will have significant consequences for networks with self-loops.
4.3. Behavior in graphs 'with traps'
Let us simulate a situation in which a particle is hopping through the nodes of a linear chain in which we have placed a 'potential barrier' in one of the nodes as illustrated in figures 2(a) and (b) for the cases where there is not nonlocal hops (a) and where such nonlocal interactions are present (b). The potential barrier is represented here by a weighted self-loop at the node i as illustrated in figures 2(c) and (d), which corresponds to the cases illustrated in (a) and (b), respectively. The height of the barrier is , which is then used as the weight for a self-loop located at the node i. That is, when w = 0 there is no barrier and the diffusion occurs without any 'obstacle' at the node i. We then simulate the diffusion of the particle from a node by using the local, fractional and path Laplacian matrices.
Figure 2. Schematic representation of a diffusive process across a linear chain of 4 nodes in which a membrane is located at one node, when there are local-only or through-edges nonlocal (a) and (c) and through-space nonlocal (b) and (d) interactions. Representation of the systems (a) and (b) in the form of a graph with a self-loop and the kind of hops expected in them. The parameter w represents the shielding capacity of the membrane.
Download figure:
Standard image High-resolution imageThe results of the simulations using (i) , (ii) and (iii) with initial condition , are illustrated in figure 3. We consider the processes at the very early time t = 1. However, the results are similar for other times in which the system is far from the steady state. In figure 3 we plot the results for the nodes 3 (a) and 4 (b) using 0 ⩽ w ⩽ 10, 000. As can be seen in the case of local-only interactions (i) we observe the expected continuous decay of the concentrations at nodes 3 and 4 with the height of the barrier at the node 2. In this case, as illustrated in figures 3(a) and (b) (blue circles), the concentration decays as a power-law with w: , where γ > 0 is a fitting parameter. In the case of the fractional Laplacian (ii) we observe in figures 3(a) and (b) (red squares) a behavior very similar to that of the local operator. Finally, when we consider the path Laplacian operator (iii) we see that at relatively low values of w, there is a small decay of the concentration at the nodes 3 and 4 (see figures 3(a) and (b) (triangles)), which then becomes constant at relatively large values of w. In the simulations we have used s = 2. For values s > 2 the curves converges to that of the nonlocal (standard) Laplacian. For values of s < 2 the convergence to the constant value is faster than that shown for s = 2.
Figure 3. Change of the concentration at the nodes 3 (a) and 4 (b) in a linear chain with four nodes in which the particle starts at node 1 (see figure 2 for node labeling). (Blue) circles represents the case (i), (red) squares represents the use of the fractional powers of the Laplacian matrix (case (ii)) (we considered α = 1/2) and (magenta) triangles represents the use of the d-path Laplacian operator (we used s = 2). See text for details.
Download figure:
Standard image High-resolution imageTo understand the effects of this barrier let us analyze first the case without nonlocal interactions. Suppose that the particle is diffusing from the node 1 on a linear chain of 4 nodes. With probability 1 at discrete time k = 1 the particle will move to node 2. When w = 0 (no barrier) the particle will have probability equal to 1/2 to escape from that node (either to node 1 or to 3). However, such probability is when we have placed the a barrier of height w. If the height of the barrier is high, the probability that a particle located at node 2 can hop to node 3 (or to node 1) is practically null, which makes the particle to get trapped between the node 1 and the node having the barrier.
Let us now consider the nonlocal scenarios. In these cases due to nonlocality at discrete time k = 1 the particle will populate nodes 2, 3 and 4 with probabilities that decay with their separation from node 1. In the case of the fractional Laplacian it is obvious from the previous results that the particle is not able to overcome the potential barrier. The reason for this behavior can be explained from the contributions of the terms having the form . That is, in the fractional Laplacians there are terms contributing to retain the particle at a given node. Therefore, if the degree of the node is too high, such retention can trap the particle at the corresponding node for long time. As we have created a node with extremely high degree w, i.e. the potential barrier, the trapping of the particle at the self-loop is obvious. Additionally, the backtracking nature of the diffusive process controlled by this Laplacian also plays a role in trapping the particle behind the membrane. In this case the contribution of the term accounts for the bouncing of the particle between the origin and the place where the barrier is locate. Because kw = w + 2, when w is very high the particle remains bouncing back and forth for an extremely long period of time between these two nodes. All in all, the particle gets trapped between the origin and the potential barrier.
In the case of the path Laplacians it is evident from our results that the particle is able to overcome the potential barrier. We can think of several physical scenarios in which this situation occurs. For instance, (i) the particle is very energetic as to go over the potential; (ii) the particle navigates by a combination of 'through-edges' (which will encounter the barrier) and 'through-space' navigation (which avoids the barrier); (iii) a switching potential that allows the pass of certain class of particles like the one describe by the path Laplacian. These scenarios are compatible with the observation that the concentration of the particle at nodes 3 and 4 (see figure 3) first decay with the increase of w before it stabilizes at a constant value. For instance, we can suppose that w < 20 the through-edges navigation dominates, but when the barrier height is relatively large (w > 20), the through-space jumps from 1 to 3 and from 1 to 4 dominate over the through edges transitions: 1–2–3 and 1–2–3–4. At this point the concentrations at nodes 3 and 4 remain constant because they are mainly maintained by the long-jumps and not by the through-edges hops. Mathematically, this behavior is a consequence of the fact that this operators does not produce backtracking of the diffusive particle between the nodes, which avoid that it gets trapped.
4.4. Commuting times
As we have seen before we can generate random walk processes based on the different Laplacians studied here via the embedded Markov chain. That is,
where . An important quantity in the study of random walks on graphs is the access or hitting time , which is the expected number of steps before node w is visited, for a random walk starting at node v. The sum is called the commute time, which is the expected number of steps in a random walk starting at v, before node w is visited and then the walker comes back again to node v [34]. Then, in a simple graph the expected commuting time between a pair of nodes v and w can be expressed by
where
is the resistance distance between the corresponding pair of nodes [50–55]. As we are interested in global properties of the networks we study here the average resistance distance between every pair of nodes, . The sum of all resistance distances in a graph is known as the Kirchhoff index and is expressed in terms of the eigenvalues of the corresponding Laplacian as [51, 56–58]:
where is the trace of the Moore–Penrose pseudoinverse of .
We first calculate the average commute times for all 11 117 connected graphs with 8 nodes. For the fractional Laplacians we used the values of α = 0.5, α = 0.25, and α = 0.01. For the path Laplacians we study the cases . First, we compare the average commuting times of random walks based on the local and on fractional Laplacians. For α = 0.5 we found that only in 229 graphs out of 11 117 (2.06%) the average commuting time is smaller for the fractional than for the local process. That is, in 97.94% of the graphs, a random walk based on local-only Laplacian displays smaller commute time than that based on . When α = 0.25 only 136 graphs (1.22%) display smaller commute time with the fractional than with the local Laplacian. These results are illustrated in figure 4(a). The situation is even worse for smaller values of α. For instance, for α = 0.01 there are only 64 graphs (0.58%) for which the fractional Laplacian represents an improvement in the commute time. That is, in general, a random walk based on the fractional Laplacian does not improve the commuting time between pairs of nodes, but, on the contrary, it makes this time longer. Additionally, the smaller the fractional power, the smaller the fraction of graphs which are benefited by such fractional random walks.
Figure 4. Plot of the average commute time of all connected graphs with 8 nodes (a) and of 62 real-world networks (b). The 62 real-world networks represent a wide variety of complex systems, e.g. social, ecological, biomolecular, infrastructural and informational (see Appendix in [9] for description and references). The continuous (blue) line corresponds to the distance based on local (standard) Laplacian, the broken (red) line to the one based on the fractional Laplacian and the dotted (magenta) line to the one based on the path Laplacian.
Download figure:
Standard image High-resolution imageAn analysis of the Kirchhoff index suggest that because , when the average commute time based on the local Laplacian is smaller than that based on the fractional Laplacian for any α. There are 6803 graphs for which this condition is obeyed among the 11 117 connected graphs with 8 nodes. Then, it is obvious that also for many graphs having the commute time based on local Laplacian is smaller than that based on the fractional one. We also consider here 62 real-world networks representing a wide variety of complex systems, e.g. social, ecological, biomolecular, infrastructural and informational (see appendix in [9] for description and references). In these networks we found that in 35, in 37, in 41 and in 48 of the networks analyzed (see figure 4(b)). That is, less than a half of the real-world networks studied here would benefit (in terms of the commute time) on the use of fractional random walks in comparison with local (standard) one.
We now consider for both series of graphs considered before. In the case of the 11 117 connected graphs with 8 nodes we observe that in 11 116 graphs for and both indices are identical for the complete graph. Also, for 100% of the real-world networks studied here the average commute time based on the path Laplacian is smaller than that based on the local (and on fractional) Laplacian. That is, in terms of the commute time, the process based on path Laplacian is more efficient than those based on the local and on the fractional Laplacians. The fact that for any graph can be proved as follows. Let be a simple connected graph different from the complete graph. Let be the path Laplacian of G. Then, is the adjacency matrix of a weighted complete graph . It is known that is a nonincreasing function of edge weights [59]. Then, if we reduce the weights of the edges the Kirchhoff index of the graph will not decrease. Because , we have
In closing, for any graph different from the complete graph the path Laplacian produces a random walk with smaller average commute time than the process based on the standard Laplacian. In the case of the complete graphs both processes produce the same average commute time, which is the smallest possible one.
4.5. Diffusive efficiency
To measure the efficiency of local and nonlocal diffusive processes in a graph we consider the following metric [60]:
where and is a parameter. First we show that this metric is a Euclidean distance between the corresponding pair of nodes. Let . Let φp be the pth column of UT. Then, . Therefore, if zp : = e−ζΛ/2 φp , we can write
Then, we have three Euclidean distances between the same pair of nodes: , and . Let us now explain how this measure captures the efficiency of a diffusive process. Let us consider the solution of the diffusion equation on graphs with initial condition x0(p) = 1 and x0(r) = 0 for all r ≠ p. That is . Then, the concentration of the diffusive particle 'retained' at the node p is given by and that transferred to the node q is given by . Thus, the efficiency of diffusing particles from p to q is . If we do the same for the diffusion from q to p we get . Therefore, because in an undirected network we have that , the global efficiency of diffusing between p and q is .
We use here the same series of graphs as in the previous section. In this case the results are more dramatic than for the case of the commute time. Here in 100% of the 11 117 connected graphs with 8 nodes we observe that (α = 3/4, 1/2, 1/4, 1/100). That is, the local diffusive process is always more efficient than the fractional one for all these graphs. When we study the 62 real-world networks previously considered we see that in 61 of the networks. For values of we observe that in the 62 networks. On the other side of the coin we have that () for all graphs with 8 nodes as well as for the real-world networks. Thus, again, the diffusive process controlled by the path Laplacian is more efficient than that controlled by the local (standard) Laplacian as well as by the fractional powers of it. The results are illustrated in figure 5.
Figure 5. Plot of the average diffusive distance of all connected graphs with 8 nodes (a) and of 62 real-world networks (b). The 62 real-world networks represent a wide variety of complex systems, e.g. social, ecological, biomolecular, infrastructural and informational (see appendix in [9] for description and references). The continuous (blue) line corresponds to the distance based on local (standard) Laplacian, the broken (red) line to the one based on the fractional Laplacian and the dotted (magenta) line to the one based on the path Laplacian.
Download figure:
Standard image High-resolution image5. Analysis of diffusion in brain cellular tissues
Here we propose to use local and nonlocal (fractional and path) diffusive dynamics to study the diffusion of a 'substance' through the cells in brain tissues. These tissue samples were surgically removed from different human brains from 12 different patients. They are grouped into three classes: healthy, inflamed and gliomas. Each image is taken with a magnification of 80× and consists of 384 × 384 pixels. Following Waxman [61], Gunduz et al [62] transformed these images into 'cell graphs' in which the nodes correspond to the cells in the tissue and the edges between them are based on a decaying exponential function of the Euclidean distance between every pair of cells (see [64] for a review). In figure 6 we illustrate three images corresponding to healthy, inflamed and cancerous tissues. We also illustrate the cell graphs constructed by Gunduz et al [62]. As can seen it is relatively easy to distinguish even by naked eye between healthy and unhealthy (inflamed and cancerous) tissues. The graphs of the first are very sparse and consist of several connected components. Here we always consider the largest connected component of these graphs.
Figure 6. Microscopic images of tissue samples surgically removed from human brain (a)–(c) and the corresponding cell graphs (d)–(f): (a), (d) healthy, (b), (e) inflamed and (c), (f) a brain tumor sample (i.e. glioma).
Download figure:
Standard image High-resolution imageThe goal of this study is twofold. On one hand, we are interested in analyzing the capacity of local and nonlocal diffusive processes to classify these tissues into their corresponding classes. The importance of this experiment is understood by the fact that in clinical practice, the distinction between inflammation and glioma can be a difficult task [63]. It is known that in some cases, laboratory tests are atypical and clinical symptoms and signs of both pathologies are similar [63]. On the other hand, we would like to gain some insights about possible (diffusive) mechanisms taking place on these tissues which may illuminate about their main functional differences.
We then study 90 cell graphs (30 of healthy, 30 of inflamed and 30 of glioma tissues). For every graph we calculate the local and nonlocal (fractional and path) commute times as well as the corresponding diffusive distances. Our main goal here is to see whether there are significant differences between the local and nonlocal diffusive processes in the three kinds of tissues studied such that we can (i) differentiate them as well as (ii) gain some insight about different mechanisms acting on them. For this we produce scatterplots of the local and nonlocal diffusion distances of all the tissues studied. In figures 7(a)–(c) we show the violin plots of the average commute times for the three classes of cell graphs studied. The mean values of are 4.240 for healthy, 1.357 for inflamed and 1.776 for glioma. Those for are 1.691, 1.510, and 1.531, respectively. Finally, for these values are 0.190, 0.088, and 0.102, respectively. Neither of the three kinds of commute times (local, fractional and path) produce a good separation of the three classes. Only, the path Laplacians produces a good separation of health and unhealthy tissues, but does not work well for the separation of inflamed and glioma. Interestingly, for the three classes the average commute times from the path Laplacians are significantly smaller than those based on fractional or local ones. The fractional Laplacian produces average commute time smaller than those obtained by the local operator for healthy and glioma tissues but not for the inflamed ones.
Figure 7. Violin plots of the average commute time (a)–(c) and of the average diffusive distance (d)–(f) calculated by the local (a), (d), fractional (b), (e) and path Laplacian (c), (f) for healthy, inflamed and glioma tissues.
Download figure:
Standard image High-resolution imageWe then perform a similar analysis using the average diffusive distances. Here the averages of the diffusive distances for the three classes (healthy, inflamed and glioma) are: 0.563, 0.443, and 0.448 for the local operator, 0.747, 0.713, and 0.715 for the fractional, and 0.203, 8.47 × 10−5, and 0.0021 for the path Laplacians. The fractional Laplacian always produces larger commute times than the local operator, while the path Laplacian produces always the smallest values of this parameter.
In figure 8(a) we illustrate the plot of the local versus the fractional diffusion distance. The first surprising observation is the extremely high linear correlation between both distances, which displays a Pearson correlation coefficient of 0.98. This means that 96% of the variance in the fractional diffusion distance is explained by the local diffusive one. In other words, it seems like if the fractional diffusive process does not bring any qualitatively new phenomenon into these tissues. Then (see figure 8(a)) the combination of these two variables is not able to differentiate the three classes of tissues studies here. In fact, healthy and part of the cancerous tissues are mixed up, but also some healthy tissues display similar fractional distances as the inflamed ones.
Figure 8. (a) Scatterplot of local vs fractional diffusive distance (α = 1/4) for all cell graphs analyzed here (blue circles: healthy; red diamonds: inflamed; yellow squares: glioma). (b) Visualization of the KNN clustering of healthy (circles), inflamed (squares) and glioma (diamonds) cellular tissues using diffusion distances based on local (x-axis) and path (y-axis) diffusive models. The regions delimited by KNN for the classification are colored in red (healthy), blue (inflamed) and green (glioma). (c) The same as in (b) but using instead of and the separation of classes is based on LDA.
Download figure:
Standard image High-resolution imageWe now consider the plot of local and path diffusion distances for the same set of tissues as illustrated in figure 8(b). The Pearson correlation coefficient between these two variables is only 0.59, indicating that less than 35% of the variance in the nonlocal distance is accounted for by the local one. In other words, the new diffusive process introduces significantly different qualitative phenomena in relation to the local one. The second important characteristic observed in figure 8(b), where we show the classification made by K-nearest neighbors (KNN) as implemented in Matlab, is the fact that there is a clear separation between the three groups of tissues according to these two distances. First, the healthy and unhealthy tissues are well separated by the path diffusion distance, where the healthy tissues display significantly larger average path diffusion distances than the unhealthy ones. The inflamed tissues are separated into two classes, those displaying relatively low local diffusive distance and others displaying relatively large one. In the middle we find the glioma tissues. This indicates a quadratic separation of the inflamed and glioma tissues based on the local distance. That is, if we consider instead of we reach a clear separation of the three classes as illustrated in figure 8(c). Therefore, the first goal, i.e. that of classifying the three classes of tissues, has been fulfilled. The percentage of good classification is 100% using simply linear discriminant analysis (LDA) classification.
We now focus on the potential meaning of our results. The first observation is that nonlocal diffusive processes controlled by the fractional Laplacian are not able to describe what is happening in these tissues, while the path Laplacian describes some effects that allows the differentiation of the three kinds of tissues. This may imply that some kind of non-backtracking processes are taking place in these tissues, particularly in unhealthy ones. One example of such kind of diffusive process is the 'through-space' one, as we have described before. In the case of cellular tissues this can be explained by the existence of 'transporters' that can move substances from one cell to another outside the cellular network. This is the case of exosomes, which are nano-vesicles used as vehicles to transfer proteins, lipids and nucleic acids from one cell to another. Exosomes are secreted by glioma cells facilitating the transport of receptors, signaling molecules, oncogenic genes and miRNA [65]. They are currently recognized as key components in the biogenesis of gliomas, which modify their surrounding microenvironment to support tumor progression. In addition, exosomes play a fundamental role in inflammatory processes [66], such as in the transport of pro-inflammatory cytokines.
We now search for indirect evidence about the role played by the structure of the cellular graphs on the behavior of both local and nonlocal diffusive processes. Hereafter we will only focus on the path Laplacian as the nonlocal process. With this goal in mind we perform randomization of the cell graphs, such that we rewire their edges by keeping the degree of the nodes. We then calculate and as the average of 100 random rewiring. In figure 9 we illustrate the results for the three classes of tissues studied.
Figure 9. Plot of the average diffusion distances (local and nonlocal) between every pair of nodes in the cellular graphs (blue circles) of healthy (a), inflamed (b) and glioma (c) tissues. The average diffusion distances of the same graphs with a complete random rewiring of edges are plotted as red squares.
Download figure:
Standard image High-resolution imageAs can be seen in figure 9(a) the random rewiring of the cells graphs of healthy tissues makes difficult to distinguish the real (blue circles) from the random (red squares) graphs. However, statistically the nonlocal diffusive distance of the real networks are bigger than those of the random ones (see table 1), indicating a relative small diffusive efficiency of the real networks to nonlocal processes. In the case of inflamed tissues the randomization destroys completely the structural characteristics of these cell graphs which produce the observed diffusive behavior. In particular, the inflamed tissues display slightly worse local 'diffusive efficiency', i.e. longer distances, than their random analogues as can be seen by the mean distances in table 1. However, they are significantly more efficient than the random ones in the nonlocal diffusion. In other words, it seems like if the inflamed tissues produce certain structural patterns which increase their efficiency for nonlocal diffusion in detriment of the local one. Finally, in the case of gliomas we see again the separation previously observed in figure 8(b). There is a subgroup (hereafter named subgroup I) located at the left-bottom part of the plot, which have slightly less diffusive efficiency than the random analogues (see table 1) but with a significant improvement of their nonlocal diffusive efficiency. The second subgroup (labeled II in table 1), which is located at the right-bottom part of the plot, has approximately the same diffusive capacity as the randomized ones, but displaying a significant improvement in their nonlocal diffusive efficiency.
Table 1. Values of the average diffusive distance based on local and path Laplacians for the cell graphs of health, inflamed and glioma tissues, as well as their randomized versions. The glioma tissues are subdivided into two subgroups (see text for details). The probability that the difference between the two means is significant at 95% of confidence is calculated based on the two-samples t-test.
Real | Rand. | Real | Rand. | |||
---|---|---|---|---|---|---|
Healthy | 0.563 | 0.539 | 0.7092 | 0.203 | 0.139 | 0.9892 |
Inflamed | 0.445 | 0.374 | 1.0000 | 9.17 × 10−5 | 0.020 | 1.0000 |
Glioma (I) | 0.327 | 0.252 | 0.9998 | 1.71 × 10−7 | 0.005 | 0.9904 |
Glioma (II) | 0.57 | 0.55 | 0.9168 | 0.0041 | 0.062 | 1.0000 |
As can be seen in figure 8(b) the networks representing healthy tissues are the ones where nonlocal diffusion produces the least improvement in the diffusion efficiency (measured by the diffusion distances) in relation to the local one. This means that in healthy tissues local diffusive processes reach efficiencies which are comparable to the nonlocal ones, i.e. the ratio of the nonlocal to local diffusive distance is less than 3. In the cases of unhealthy tissues this change is dramatic. For instance, the ratio of the local to nonlocal diffusive distance in the glioma (group II) is 139, in glioma (group I) is 4853 and in inflamed is almost 2 millions. These results indicate that in these tissues the presence of nonlocal diffusive mechanisms will benefit the efficiency of the processes in extremely high proportions in relation to local processes.
Finally, we speculate about the possible reasons for the separation of the glioma tissues into two separated classes. Unfortunately, we do not have clinical details about the kinds of gliomas corresponding to each of the tissues. According to the World Health Organization (WHO), gliomas are classified into four grades, which represents the overall malignant potential of the tumor [67–69]. In particular, the differentiation between low-grade gliomas (grade II) and high-grade gliomas (grades III, IV) is extremely important for the prognosis and the therapeutic strategy to follow. While WHO grades I and II gliomas are slow growing [67], WHO grade III gliomas are rapidly growing [67]. Therefore, we think that the separation observed would correspond with the separation between low- and high-grade gliomas due to their different growing mechanisms and histopathologic characteristics. More data and experiments are needed to falsify this hypothesis.
6. Conclusions
From the current investigation of the two nonlocal Laplacian operators for networks, i.e. fractional and path Laplacian, we can conclude the following.
- Path-based nonlocal diffusion always converges faster than, or at the same rate as, the local diffusion.
- Fractional nonlocal diffusion converges slower than the local process if the algebraic connectivity of the graph is not smaller than one, which is frequently the case.
- Fractional Laplacians describe backtracking processes on graphs. Consequently, the diffusion can get trapped between the initial node and an obstacle located at another node, such as a self-loop.
- Path Laplacians describe non-backtracking jumps, which may represent through-space navigation in the graphs, which overcome obstacles as the ones before mentioned.
- Fractional diffusion frequently has longer commute times and worse diffusive efficiency than the standard diffusion process.
- Path-based diffusion always produces smaller commute times and better diffusive efficiencies than the standard diffusion.
- Diffusive processes based on path Laplacians are able to classify correctly 100% of cellular brain samples from healthy, inflamed and glioma, but such classification was not possible using diffusive processes based on the fractional Laplacian.
Acknowledgments
The author thanks Professor Bülent Yener (Rensselaer Polytechnic Institute) for the cell cancer datasets, the tissue images illustrated in figure 6 as well as for useful discussions about this topic. Revision of a former version of the manuscript as well as useful comments and discussions about the two classes of nonlocal Laplacians studied here are also thanked to Professor Michele Benzi (Scuola Normale Superiore di Pisa). The author thanks financial support from Ministerio de Ciencia, Innovacion y Universidades, Spain for the Grant PID2019-107603GB-I00 'Hubs-repelling/attracting Laplacian operators and related dynamics on graphs/networks'.
Data availability statement
The data that support the findings of this study are available upon reasonable request from the authors.
: Appendix.
Figure 10. Time evolution of the state (concentration) of a diffusive particle at the different nodes of a linear chain with 100 nodes. The plots correspond to the use of the three different Laplacian (a), (b) and (c). Notice that for the standard Laplacian (a) the convergence is reached for t > 1000. Also notice that in the cases of the local Laplacian (a) at times t < 100 there are nodes which have not been visited by the particle, e.g. its concentrations are close to zero at rounding error of Matlab. This is not the case for the nonlocal Laplacians were such concentrations are about 10−4 for very early times.
Download figure:
Standard image High-resolution imageFigure 11. Time evolution of the state (concentration) of a diffusive particle at the different nodes of a complete graph with 100 nodes. The plots correspond to the use of the three different Laplacian (a), (b) and (c). Notice that for (a), and (c) the convergence is immediately at t = 1. This is not the case for the where the steady state is only reached at t > 50.
Download figure:
Standard image High-resolution image