https://DevOpsCloud.io -- Cloud Monk Losang Jinpa, Ph.D., MCSE/MCT, GitOps DevOps Engineer

Return to Data Science, Machine Learning - Deep Learning, Scala Machine Learning, DataOps-MLOps-DevOps, Scala Official Glossary, Scala Topics, Scala, Scala DevOps - Scala SRE, Scala DataOps, Scala MLOps

• Apache Spark
• Apache Kafka

Snippet from Wikipedia: Data science

Data science is an interdisciplinary academic field that uses statistics, scientific computing, scientific methods, processing, scientific visualization, algorithms and systems to extract or extrapolate knowledge from potentially noisy, structured, or unstructured data.

Data science also integrates domain knowledge from the underlying application domain (e.g., natural sciences, information technology, and medicine). Data science is multifaceted and can be described as a science, a research paradigm, a research method, a discipline, a workflow, and a profession.

Data science is "a concept to unify statistics, data analysis, informatics, and their related methods" to "understand and analyze actual phenomena" with data. It uses techniques and theories drawn from many fields within the context of mathematics, statistics, computer science, information science, and domain knowledge. However, data science is different from computer science and information science. Turing Award winner Jim Gray imagined data science as a "fourth paradigm" of science (empirical, theoretical, computational, and now data-driven) and asserted that "everything about science is changing because of the impact of information technology" and the data deluge.

A data scientist is a professional who creates programming code and combines it with statistical knowledge to summarize data.

Creative Commons Attribution-Share Alike 4.0

Research:

• Scala Data science on DuckDuckGo
• Scala Data science on O'Reilly
• Scala Data science on GitHub
• Scala Data science on Reddit
• Scala Data science on StackOverflow
• Scala Data science on scholar.google.com
• Scala Data science on YouTube

Fair Use Sources:

Scala Programming Language, Scala Compiler, Scala sbt (Scala Build Tool), Scala IntelliJ Integration, Scala ScalaTest, Scala Akka Actor Model, Scala Functional Programming Style, Scala Case Class, Scala Companion Object, Scala Object Keyword, Scala Class Keyword, Scala Trait Keyword, Scala Val Keyword, Scala Var Keyword, Scala Def Keyword, Scala Lazy Val, Scala Immutable Collections, Scala Mutable Collections, Scala Option Type, Scala Some Type, Scala None Type, Scala Map Collection, Scala Seq Collection, Scala List Collection, Scala Vector Collection, Scala Set Collection, Scala Tuple Type, Scala Unit Type, Scala Any Type, Scala AnyRef Type, Scala AnyVal Type, Scala Null Type, Scala Nothing Type, Scala Singleton Object, Scala Type Inference, Scala Pattern Matching, Scala For-Comprehension, Scala Lambda Expression, Scala Higher-Order Function, Scala Partial Function, Scala Currying, Scala Tail Recursion, Scala Recursion Optimization, Scala Immutable Map, Scala Immutable List, Scala Immutable Set, Scala Immutable Vector, Scala Immutable Seq, Scala Iterator Type, Scala Iterable Trait, Scala IndexedSeq Trait, Scala Range Type, Scala Stream (Lazy List) Type, Scala LazyList Type, Scala Fold Operation, Scala Reduce Operation, Scala Map Operation, Scala Filter Operation, Scala FlatMap Operation, Scala Foreach Operation, Scala Sort Operations, Scala Zip Operation, Scala GroupBy Operation, Scala Drop Operation, Scala Take Operation, Scala Slice Operation, Scala Partition Operation, Scala Span Operation, Scala SplitAt Operation, Scala Head Method, Scala Tail Method, Scala Init Method, Scala Last Method, Scala DropWhile Method, Scala TakeWhile Method, Scala FoldLeft Method, Scala FoldRight Method, Scala ReduceLeft Method, Scala ReduceRight Method, Scala Scan Operation, Scala ScanLeft Operation, Scala ScanRight Operation, Scala Indexed Access, Scala String Interpolation, Scala Raw String Interpolation, Scala S String Interpolation, Scala F String Interpolation, Scala Interpolated Strings, Scala StringOps, Scala RichInt, Scala RichDouble, Scala RichChar, Scala RichBoolean, Scala RichLong, Scala RichFloat, Scala RichByte, Scala RichShort, Scala Implicit Conversions, Scala Implicit Parameters, Scala Implicit Class, Scala Implicit Object, Scala Implicit Value, Scala Type Class Pattern, Scala Evidence Parameter, Scala Context Bound, Scala View Bound (deprecated), Scala Triple Quotes (Scala 3), Scala Extension Methods, Scala Given Instances, Scala Using Clauses, Scala Given Keyword (Scala 3), Scala Export Keyword (Scala 3), Scala Opaque Type (Scala 3), Scala Intersection Types (Scala 3), Scala Union Types (Scala 3), Scala Dependent Types, Scala Path-Dependent Types, Scala Self Type Annotation, Scala Structural Types, Scala Singleton Types, Scala Type Aliases, Scala Parameterized Types, Scala Type Parameters, Scala Type Bounds, Scala Upper Bound, Scala Lower Bound, Scala Context Function Types, Scala Polymorphic Function Types (Scala 3), Scala Parametric Polymorphism, Scala Ad-Hoc Polymorphism, Scala Subtyping, Scala Variance, Scala Covariance, Scala Contravariance, Scala Invariance, Scala Abstract Type Members, Scala Abstract Class, Scala Concrete Class, Scala Final Keyword, Scala Sealed Keyword, Scala Lazy Keyword, Scala Override Keyword, Scala Transparent Trait (Scala 3), Scala Transparent Inline (Scala 3), Scala Inline Method (Scala 3), Scala Macro (Scala 2.x) (deprecated), Scala Macro Paradise (deprecated), Scala TASTy Reflection (Scala 3), Scala Metaprogramming, Scala Quoted Expressions (Scala 3), Scala Quoted Type (Scala 3), Scala Inline Given (Scala 3), Scala By-Name Parameters, Scala By-Name Types, Scala Call-by-Name, Scala Call-by-Value, Scala Default Parameters, Scala Named Parameters, Scala Varargs Parameter, Scala Class Parameter, Scala Constructor Parameter, Scala Primary Constructor, Scala Auxiliary Constructor, Scala This Constructor, Scala Super Constructor Call, Scala Self Parameter in Traits, Scala Mixin Composition, Scala Linearization, Scala Early Initializers (deprecated), Scala Lazy Initialization, Scala Reference Equality (eq, ne), Scala Structural Equality (==, !=), Scala Universal Equality, Scala Type Equality Operator (===) (scalaz or cats), Scala Ordering, Scala Ordering Implicit, Scala Ordering.by Function, Scala Equiv Typeclass, Scala Numeric Typeclass, Scala Fractional Typeclass, Scala Integral Typeclass, Scala Ordering for Int, Scala Ordering for String, Scala Ordering for Custom Types, Scala PartialOrder Typeclass (cats), Scala Monoid Typeclass (cats), Scala Semigroup Typeclass (cats), Scala Functor Typeclass (cats), Scala Monad Typeclass (cats), Scala MonadError Typeclass (cats), Scala Applicative Typeclass (cats), Scala Foldable Typeclass (cats), Scala Traverse Typeclass (cats), Scala Show Typeclass (cats), Scala Eq Typeclass (cats), Scala Contravariant Functor (cats), Scala Invariant Functor (cats), Scala Kleisli (cats), Scala Either Type, Scala Left Projection (deprecated), Scala Right Projection (deprecated), Scala Try Type, Scala Success Type, Scala Failure Type, Scala Future Type (scala.concurrent), Scala ExecutionContext, Scala Promise Type (scala.concurrent), Scala Await Object (scala.concurrent), Scala blocking Call (scala.concurrent), Scala Duration Type (scala.concurrent), Scala FiniteDuration, Scala PartialFunction Type, Scala PartialFunction.applyOrElse, Scala PartialFunction.lift, Scala Collect Method on Collections, Scala Partition Method on Collections, Scala Span Method on Collections, Scala Unzip Method, Scala Concat Method, Scala Intersect Method, Scala Diff Method, Scala Union Method, Scala Distinct Method, Scala Patch Method, Scala Updated Method, Scala UpdatedWith Method (Scala 2.13+), Scala fold Methods on Maps, Scala transform Methods on Maps, Scala withDefault Method on Maps, Scala SortedSet, Scala SortedMap, Scala TreeSet, Scala TreeMap, Scala Immutable Queue, Scala Immutable Stack, Scala Immutable LazyList, Scala View (scala.collection.View), Scala Iterator to Stream Conversion (deprecated), Scala LinearSeq, Scala IndexedSeq, Scala LinearSeqOps, Scala IndexedSeqOps, Scala Strict Optimizations, Scala Lazy Evaluations, Scala Call-by-Name Arguments, Scala Streams (2.12) deprecated, replaced by LazyList, Scala Regex Class (scala.util.matching), Scala Regex Groups, Scala Regex findAllIn, Scala Regex replaceAllIn, Scala Regex replaceFirstIn, Scala Regex findFirstIn, Scala BigInt Type, Scala BigDecimal Type, Scala Numeric Literal Suffix, Scala Triple Quotes for multiline strings, Scala StringOps Methods (map, flatMap, etc.), Scala CharOps, Scala ArrayOps, Scala JavaConverters (deprecated in Scala 2.13), Scala Java Collection Converters (Scala 2.13+), Scala toScala methods, Scala toJava methods, Scala reflection API (scala.reflect), Scala Symbol Type (deprecated), Scala Symbol Literal 'x (deprecated), Scala Enumeration Type, Scala Enumerations are discouraged, Scala scala.util.Random, Scala scala.util.Try, Scala scala.util.Success, Scala scala.util.Failure, Scala scala.util.Either, Scala scala.util.Left, Scala scala.util.Right, Scala scala.util.Using, Scala scala.util.Using.Manager, Scala scala.util.Sorting, Scala scala.util.Properties, Scala scala.sys Process, Scala scala.sys.env Map, Scala scala.sys.props Map, Scala scala.collection.mutable, Scala mutable ArrayBuffer, Scala mutable ListBuffer, Scala mutable Map, Scala mutable Set, Scala mutable HashMap, Scala mutable HashSet, Scala mutable LinkedHashMap, Scala mutable LinkedHashSet, Scala mutable Buffer, Scala mutable Stack, Scala mutable Queue, Scala mutable PriorityQueue, Scala mutable SynchronizedQueue (deprecated), Scala mutable WeakhashMap (Java interop), Scala mutable ArrayStack (deprecated), Scala mutable StringBuilder, Scala mutable StringOps, Scala mutable UnrolledBuffer (deprecated), Scala mutable TreeSet (deprecated, Scala mutable TreeMap (deprecated, Scala concurrent.Future, Scala concurrent.Promise, Scala concurrent.BlockingContext, Scala concurrent.ExecutionContext.Implicits, Scala concurrent.duration package, Scala concurrent.duration.SECONDS, Scala concurrent.duration.MILLISECONDS, Scala concurrent.duration FiniteDuration, Scala concurrent.ExecutionContext global, Scala concurrent.Lock, Scala concurrent.AtomicReference (Java Interop), Scala Standard Library Index, Scala Predef Object, Scala Predef., Scala Predef.assume Function, Scala Predef.require Function, Scala Predef.assert Function, Scala Predef.implicitly Function, Scala Predef.identity Function, Scala Predef.classOf[T], Scala Predef.printf Function, Scala Predef.readLine Function, Scala System.err, Scala System.out, Scala System.in, Scala scala.Console, Scala Console.println, Scala Console.readLine, Scala Console.withIn, Scala Console.withOut, Scala Console.withErr, Scala Console.setOut, Scala Console.setIn, Scala Console.setErr, Scala math Package, Scala math.Ordering, Scala math.BigInt, Scala math.BigDecimal, Scala math.sqrt, Scala math.pow, Scala math.log, Scala math.exp, Scala math.sin, Scala math.cos, Scala math.tan, Scala math.abs, Scala math.max, Scala math.min, Scala math.ceil, Scala math.floor, Scala math.round, Scala math.random, Scala reflect Manifest, Scala reflect ClassTag, Scala reflect TypeTag, Scala reflect api, Scala reflect runtime, Scala reflect macros (2.x) (deprecated), Scala reflect ClassManifest (deprecated), Scala annotation.tailrec, Scala annotation.unchecked.uncheckedVariance, Scala annotation.varargs, Scala annotation.bridge (internal), Scala annotation.elidable, Scala annotation.strictfp, Scala annotation.switch, Scala annotation.experimental (Scala 3), Scala annotation.nowarn, Scala annotation.alpha (Scala 3), Scala Duration Type (scala.concurrent.duration), Scala FiniteDuration methods, Scala ExecutionContext from Executors, Scala Future.firstCompletedOf, Scala Future.firstCompletedOf on Seq, Scala Future.foldLeft, Scala Future.foldRight, Scala Future.traverse, Scala Future.sequence, Scala Future.onComplete, Scala Future.failed, Scala Future.successful, Scala Future.fromTry, Scala Future.reduceLeft, Scala Future.zip, Scala Future.fallbackTo, Scala parallel collections (deprecated in stdlib), Scala Parallel Collections on separate module, Scala cats Integration (not standard, but widely used), Scala scalaz Integration (older), Scala ZIO Library Integration, Scala Monix Integration, Scala FS2 Integration, Scala MUnit Testing, Scala ScalaCheck Testing, Scala ScalaMock Testing, Scala Scalatest.FunSuite, Scala Scalatest.FlatSpec (deprecated), Scala Scalatest.funspec.AnyFunSpec, Scala Scalatest.funsuite.AnyFunSuite, Scala Scalatest.wordspec.AnyWordSpec, Scala Scalatest.matchers.should.Matchers, Scala Scalatest.matchers.must.Matchers, Scala Scalatest.prop.PropertyChecks (deprecated), Scala Scalatestplus integration, Scala JUnit Integration, Scala Mockito Integration, Scala Specs2 Integration, Scala ScalaCheck Prop, Scala ScalaCheck Gen, Scala ScalaCheck Arbitrary, Scala ScalaCheck forAll, Scala ScalaCheck Test Parameters, Scala ScalaJS Integration, Scala ScalaJS bundler, Scala ScalaJS IR, Scala ScalaJS Linking, Scala ScalaJS DOM APIs, Scala Scala Native Integration, Scala Scala Native nativelib, Scala Scala Native linking, Scala Scalafmt Formatting, Scala Scalafix Refactoring, Scala Semanticdb Integration, Scala Metals LSP, Scala Scalac Options, Scala -X Options (scalac), Scala -Y Options (scalac), Scala -language Options (scalac), Scala Cross Compilation, Scala Cross Versioning with sbt, Scala sbt Keys, Scala sbt Tasks, Scala sbt Settings, Scala sbt Plugins, Scala sbt dependency Management, Scala sbt TestFramework, Scala sbt Shell, Scala sbt Assembly Plugin, Scala sbt Native Packager, Scala sbt Scripted Tests, Scala sbt multi-project builds, Scala sbt crossProject, Scala sbt libraryDependencies, Scala sbt resolvers, Scala sbt publish to Maven, Scala Modules (like scala-xml), Scala Modules (like scala-parallel-collections), Scala Modules (like scala-collection-compat), Scala Modules (like scala-java8-compat), Scala Modules (like scala-async), Scala Modules (like scala-parser-combinators), Scala Modules (like scala-swing) (deprecated), Scala Modules (like scala-collection-contrib), Scala Dotty (Scala 3 Compiler), Scala Dotty Features (Union Types, Intersection Types), Scala Dotty enums, Scala Dotty given/using keywords, Scala Dotty extension methods syntax, Scala Dotty opaque type aliases, Scala Dotty inline macros, Scala Dotty Match Types, Scala Dotty Typelevel Programming, Scala Dotty scala.compiletime package, Scala Dotty Errors and Warnings enhancements, Scala Dotty TASTy format, Scala Dotty Toolbox (experimental), Scala Dotty From Tasty Reflection API, Scala Dotty Macros (Scala 3) experimental, Scala Dotty Shorthand lambda syntax, Scala Dotty Control-Structures.

Scala: Scala Fundamentals, Scala 3, Scala 2, SBT-Maven-Gradle, JVM, Scala Keywords, Scala Built-In Data Types, Scala Data Structures - Scala Algorithms, Scala Syntax, Scala OOP - Scala Design Patterns, Scala Installation (Scala 3 on Windows, Scala 3 on Linux, Scala 3 on macOS), Scala Containerization, Scala Configuration, Scala IDEs (JetBrains IntelliJ), Scala Linter, Scala on JVM, Scala Development Tools, Scala Compiler, Scala Transpiler (Scala.js, Scala Native), Scala REPL, Scala Testing (ScalaTest, ScalaCheck, JUnit, Hamcrest, Mockito, Selenium, TestNG), Scala Data Science - Scala DataOps, Scala Machine Learning - Scala MLOps, Scala Deep Learning, Functional Scala, Scala Concurrency - Scala Parallel Programming, Scala Libraries (Akka Toolkit), Scala Frameworks (Play Framework, Scalatra), Scala History, Scala Bibliography, Manning Scala Series, Scala Courses, Scala Glossary - Glossaire de Scala - French, Scala Topics, Scala Research, Scala GitHub, Written in Scala (Apache Spark, Apache Kafka, Apache Helix), Scala Popularity, Scala Awesome. (navbar_scala - see also navbar_scala_standard_library, navbar_scala_libraries, navbar_scala_reserved_words, navbar_scala_functional, navbar_scala_concurrency, navbar_jvm, navbar_java)