Skip Navigation Links
Discontinuity, Nonlinearity, and Complexity

Dimitry Volchenkov (editor), Dumitru Baleanu (editor)

Dimitry Volchenkov(editor)

Mathematics & Statistics, Texas Tech University, 1108 Memorial Circle, Lubbock, TX 79409, USA

Email: dr.volchenkov@gmail.com

Dumitru Baleanu (editor)

Cankaya University, Ankara, Turkey; Institute of Space Sciences, Magurele-Bucharest, Romania

Email: dumitru.baleanu@gmail.com


A Modified Multivariate Permutation Entropy Algorithm

Discontinuity, Nonlinearity, and Complexity 15(1) (2026) 15--22 | DOI:10.5890/DNC.2026.03.002

Kazimieras Pukenas

Department of Health Promotion and Rehabilitation, Lithuanian Sports University, Sporto 6, LT-44221, Kaunas, Lithuania

Download Full Text PDF

 

Abstract

This paper proposes a modified multivariate permutation entropy (MPE) algorithm to quantify the complexity of the multi-dimensional time series. The novelty of the algorithm lies in a multivariate ordinal pattern representation which requires a significantly smaller number of combinations of obtained multivariate ${d}$-order permutations for ${m}$-dimensional time series, comparing the direct application of a univariate permutation entropy to the multi-dimensional time series and resulting in the value of $d!{}^{m}$ combinations. More specifically, the number of combinations of multivariate ordinal patterns is reduced to $d!{}^{k}$ with ${k}<<{m}$ by obtaining the patterns from \textit{k}-dimensional time series, randomly selected with multiple repetitions from the ${m}$-dimensional time series. The final distribution of the multivariate ordinal patterns is obtained by the summation of these patterns across all repetitions. The capabilities of the proposed method are verified based on numerical experiments and empirical multidimensional data sets. The method is specifically applied to i) a multivariate deterministic system (a network of ten chaotic R\"{o}ssler oscillators diffusively coupled to their nearest neighbors); ii) a multivariate noise field that is colored in space and white in time; and iii) multi-channel electroencephalogram (EEG) recordings.

References

  1. [1]  Bandt, C. and Pompe, B. (2002), Permutation entropy: a natural complexity measure for time series, Physical Review Letters, 88(17), 1-4.
  2. [2]  Zunino, L., Soriano, M.C., and Rosso, O.A. (2012), Distinguishing chaotic and stochastic dynamics from time series by using a multiscale symbolic approach, Physical Review E, 86, 046210.
  3. [3]  Cao, Y., Tung, W.W., Gao, J., Protopopescu, V.A., and Hively, L.M. (2004), Detecting dynamical changes in time series using the permutation entropy, Physical Review E, 70, 046217.
  4. [4]  Bandt, C. (2017), A new kind of permutation entropy used to classify sleep stages from invisible EEG microstructure, Entropy, 19, 197.
  5. [5]  Li, J., Yan, J., Liu, X., and Ouyang, G. (2014), Using permutation entropy to measure the changes in EEG signals during absence seizures, Entropy, 16, 3049-3061.
  6. [6]  Fadlallah, B., Chen, B., Keil, A., and Principe, J. (2013), Weighted-permutation entropy: a complexity measure for time series incorporating amplitude information, Physical Review E, 87, 022911.
  7. [7]  Li, D., Li, X., Liang, Z., Voss, L.J., and Sleigh, J.W. (2010), Multiscale permutation entropy analysis of EEG recordings during sevoflurane anesthesia, Journal of Neural Engineering, 7(4), 046010.
  8. [8]  Yin, Y. and Shang, P. (2014), Weighted multiscale permutation entropy of financial time series, Nonlinear Dynamics, 78, 2921-2939.
  9. [9]  Wu, S.D., Wu, C.W., Lee, K.Y., and Lin, S.G. (2013), Modified multiscale entropy for short-term time series analysis, Physica A: Statistical Mechanics and its Applications, 392, 5865-5873.
  10. [10]  Humeau-Heurtier, A., Wu, C.W., and Wu, S.D. (2015), Refined composite multiscale permutation entropy to overcome multiscale permutation entropy length dependence, IEEE Signal Processing Letters, 22, 2364-2367.
  11. [11]  Yang, C. and Jia, M. (2021), Hierarchical multiscale permutation entropy-based feature extraction and fuzzy support tensor machine with pinball loss for bearing fault identification, Mechanical Systems and Signal Processing, 149, 107182.
  12. [12]  Voltarelli, L.G.J.M., Pessa, A.A.B., Zunino, L., Zola, R.S., Lenzi, E.K., Perc, M., and Ribeiro, H.V. (2024), Characterizing unstructured data with the nearest neighbor permutation entropy, Chaos, 34, 053130.
  13. [13]  Ribeiro, H.V., Zunino, L., Lenzi, E.K., Santoro, P.A., and Mendes, R.S. (2012), Complexity-entropy causality plane as a complexity measure for two-dimensional patterns, Plos One, 7(8), e40689.
  14. [14]  Mohr, M., Wilhelm, F., Hartwig, M., Möller, R., and Keller, K. (2020), New approaches in ordinal pattern representations for multivariate time series, Proceedings of the FLAIRS Conference, 124-129.
  15. [15]  Ma, D., He, S., and Sun, K. (2021), A modified multivariable complexity measure algorithm and its application for identifying mental arithmetic task, Entropy, 23, 931.
  16. [16]  Cánovas, J.S. and Guillamón, A. (2011), Permutations and time series analysis, Chaos, 19, 043103.
  17. [17]  Osorio, I. and Lai, Y.C. (2011), A phase-synchronization and random-matrix based approach to multichannel time-series analysis with application to epilepsy, Chaos, 21, 033108.
  18. [18]  Zhang, Y., Liu, C., Wei, S., Liu, Y., and Liu, H. (2018), Complexity analysis of physiological time series using a novel permutation-ratio entropy, IEEE Access, 6, 67653-67664.
  19. [19]  Gowda, K. and Kuehn, C. (2017), Early-warning signs for pattern-formation in stochastic partial differential equations, Communications in Nonlinear Science and Numerical Simulation, 22, 55-69.