Tagged articles
138 articles
Page 2 of 2
Big Data Technology & Architecture
Big Data Technology & Architecture
Mar 11, 2019 · Fundamentals

Scala Array Basics: Declaration, Operations, and Methods

This article introduces Scala arrays, covering their declaration, element access, multidimensional arrays, common operations such as iteration, summation, finding maximum values, concatenation, range creation, and a comprehensive list of array methods, all illustrated with clear code examples.

ArraysCode ExamplesData Structures
0 likes · 10 min read
Scala Array Basics: Declaration, Operations, and Methods
Big Data Technology & Architecture
Big Data Technology & Architecture
Mar 11, 2019 · Fundamentals

Understanding Closures in Scala

This article explains the concept of closures, showing how a function can capture external variables, illustrated with Scala examples that demonstrate anonymous functions, free variables, and a complete runnable program producing expected output.

Scalaclosurefunctional
0 likes · 3 min read
Understanding Closures in Scala
Big Data Technology & Architecture
Big Data Technology & Architecture
Mar 9, 2019 · Fundamentals

Understanding Methods and Functions in Scala

This article explains the distinction between methods and functions in Scala, demonstrates how to declare, define, and invoke them using val, def, and object syntax, and provides multiple code examples illustrating abstract methods, return types, Unit, and practical method calls.

Scalafunctionsmethods
0 likes · 4 min read
Understanding Methods and Functions in Scala
Big Data Technology & Architecture
Big Data Technology & Architecture
Mar 9, 2019 · Fundamentals

Scala Data Types and Literals Overview

This article introduces Scala’s built‑in data types, explains their characteristics, and demonstrates how to write various literals—including integers, floating‑point numbers, booleans, symbols, characters, strings, multi‑line strings, and null values—while also covering escape sequences and example code.

Data TypesLiteralsScala
0 likes · 7 min read
Scala Data Types and Literals Overview
Big Data Technology & Architecture
Big Data Technology & Architecture
Mar 9, 2019 · Fundamentals

Scala Access Modifiers: private, protected, and public

This article explains Scala's access modifiers—private, protected, and public—including their default visibility, stricter rules compared to Java, scoped protection syntax, and multiple code examples illustrating how these modifiers affect member accessibility in nested and package structures.

Access ModifiersPrivateProtected
0 likes · 5 min read
Scala Access Modifiers: private, protected, and public
Big Data Technology & Architecture
Big Data Technology & Architecture
Mar 9, 2019 · Fundamentals

Introduction to Scala: A Beginner's Guide

This article provides a concise overview of Scala for beginners, covering its multi‑paradigm nature, object‑oriented and functional features, powerful static type system, extensibility mechanisms, and seamless Java interoperability, laying a foundation for later Spark learning.

Object-OrientedProgramming LanguageScala
0 likes · 4 min read
Introduction to Scala: A Beginner's Guide
Big Data Technology & Architecture
Big Data Technology & Architecture
Jan 2, 2019 · Big Data

Optimizing Spark Direct Kafka Consumption: Subpartition Concurrency and Repartition Strategies

To address the long processing time caused by uneven Spark partitions when reading Kafka via the Direct approach, this article explains the SPARK‑22056 solution that modifies KafkaRDD.getPartitions to support a configurable 'topic.partition.subconcurrency' parameter, discusses its trade‑offs, and presents alternative repartition and multithreading techniques.

Big DataPartitioningScala
0 likes · 6 min read
Optimizing Spark Direct Kafka Consumption: Subpartition Concurrency and Repartition Strategies
Youzan Coder
Youzan Coder
Dec 17, 2018 · Backend Development

Gatling Dubbo Load Testing Plugin: Architecture, DSL, and Implementation Guide

The Gatling‑Dubbo plugin extends Gatling’s high‑performance, event‑driven load‑testing framework with a Dubbo protocol layer, providing protocol, action, and JsonPath‑based check components plus a HTTP‑like DSL, enabling asynchronous generic calls, response validation, throttling, and full example simulations for distributed Dubbo service testing.

DSLGatlingScala
0 likes · 15 min read
Gatling Dubbo Load Testing Plugin: Architecture, DSL, and Implementation Guide
High Availability Architecture
High Availability Architecture
Jul 19, 2017 · Artificial Intelligence

Weiflow: A Scalable Machine Learning Workflow Framework for Sina Weibo

The article introduces Weiflow, a dual‑layer DAG‑based machine‑learning workflow framework designed for Sina Weibo, and explains how its modular XML configuration, Scala implementation, and integration with Spark, TensorFlow, Hive, Storm, and Flink improve development efficiency, scalability, and execution performance across the entire ML pipeline.

Big DataDAGScala
0 likes · 16 min read
Weiflow: A Scalable Machine Learning Workflow Framework for Sina Weibo
MaGe Linux Operations
MaGe Linux Operations
Apr 13, 2017 · Big Data

How to Choose the Right Language for Your Big Data Project

This article compares R, Python, Scala, and Java for big‑data projects, outlining each language’s strengths and weaknesses, and offers guidance on selecting the most suitable language based on project requirements, team expertise, and production needs.

Big DataPythonR
0 likes · 8 min read
How to Choose the Right Language for Your Big Data Project
StarRing Big Data Open Lab
StarRing Big Data Open Lab
Sep 21, 2016 · Artificial Intelligence

Integrate Custom rJava Algorithms into Transwarp Discover for Scalable ML

This guide explains how to use Transwarp Discover's rJava one‑stop feature to develop, package, and share custom Java/Scala machine‑learning algorithms—such as an improved K‑Means clustering—alongside built‑in libraries, enabling seamless integration and scalable data mining within the platform.

K-MeansScalaTranswarp Discover
0 likes · 6 min read
Integrate Custom rJava Algorithms into Transwarp Discover for Scalable ML
Architect
Architect
Jun 15, 2016 · Backend Development

Understanding Kafka's SocketServer: Acceptor, Processor, and RequestChannel Architecture

This article explains the internal design of Kafka's SocketServer, detailing its NIO‑based thread model with Acceptor, Processor, and Handler threads, the startup sequence, how connections are accepted and processed, and the role of RequestChannel in routing requests and responses between processors and handlers.

BackendKafkaScala
0 likes · 17 min read
Understanding Kafka's SocketServer: Acceptor, Processor, and RequestChannel Architecture
21CTO
21CTO
May 1, 2016 · Mobile Development

Which Language Wins Android Development? Java vs Groovy vs Scala vs Kotlin

This article compares Java, Groovy, Scala, and Kotlin for Android development by examining minimal dependencies, code snippets for view lookup, click listeners, callbacks, community support, and preliminary metrics such as line count and compile speed, concluding that further analysis is needed.

AndroidGroovyKotlin
0 likes · 5 min read
Which Language Wins Android Development? Java vs Groovy vs Scala vs Kotlin
Architecture Digest
Architecture Digest
Apr 25, 2016 · Big Data

Curated Learning Resources for Spark and Scala Beginners

This article compiles a comprehensive list of tutorials, books, online courses, and tools to help beginners get started with Apache Spark and the Scala programming language, including setup instructions, code snippets, and links to free and paid learning materials.

Big DataLearning ResourcesScala
0 likes · 7 min read
Curated Learning Resources for Spark and Scala Beginners
21CTO
21CTO
Mar 19, 2016 · Backend Development

How Finagle Powers Twitter’s High‑Volume RPC: Architecture and Code Walkthrough

This article explains how Twitter’s open‑source Finagle framework, built on Netty and written in Scala/Java, provides a fault‑tolerant, protocol‑agnostic RPC layer with load balancing, metrics, tracing, and filters, enabling massive tweet traffic without latency or downtime.

FinagleNettyRPC
0 likes · 11 min read
How Finagle Powers Twitter’s High‑Volume RPC: Architecture and Code Walkthrough
21CTO
21CTO
Feb 4, 2016 · Backend Development

How Tumblr Scaled to 5 Billion Page Views: Inside Their Distributed Architecture

This article examines how Tumblr handled rapid growth—processing 5 billion daily page views, 40 k requests per second, and terabytes of data—by evolving from a LAMP stack to a Scala‑based, Finagle‑driven distributed system with HBase, Redis, Kafka, and a cell architecture that supports massive real‑time dashboards.

Backend ArchitectureDistributed SystemsFinagle
0 likes · 21 min read
How Tumblr Scaled to 5 Billion Page Views: Inside Their Distributed Architecture
ITPUB
ITPUB
Jan 11, 2016 · Big Data

Building Real‑Time Recommendations with Kiji: A Hands‑On Guide

This article explains how to use the open‑source Kiji framework together with HBase, Avro, and MapReduce to build a scalable, entity‑centric real‑time recommendation system that can instantly refresh suggestions based on user context and recent interactions.

AvroHBaseKiji
0 likes · 13 min read
Building Real‑Time Recommendations with Kiji: A Hands‑On Guide
Architect
Architect
Dec 31, 2015 · Big Data

Using Spark for Machine Learning, New Word Discovery, and Intelligent Q&A

The article explains how to leverage Apache Spark for machine‑learning tasks, large‑scale new‑word discovery, and simple intelligent question‑answering by using Spark‑Shell, Scala code, and word2vec‑based similarity, while sharing practical tips and performance considerations.

Big DataIntelligent QANew Word Discovery
0 likes · 15 min read
Using Spark for Machine Learning, New Word Discovery, and Intelligent Q&A
21CTO
21CTO
Dec 14, 2015 · Backend Development

How Wacai Built a Scalable FinTech Architecture: 6 Key Design Strategies

Wacai’s architects outline six critical design decisions—including system layer separation, message passing, asynchronous processing, comprehensive data storage, robust security, and storage redundancy—that together enable a resilient, reactive financial platform capable of handling massive concurrent workloads.

AkkaFinTechKafka
0 likes · 8 min read
How Wacai Built a Scalable FinTech Architecture: 6 Key Design Strategies
Architects Research Society
Architects Research Society
Nov 18, 2015 · Backend Development

Playful Web Development, Part 1: Managing User Authentication with Play Framework and Scala

This tutorial walks you through building a starter authentication application using Play Framework, Scala, Silhouette, and MongoDB, covering email sign‑up, password reset, OAuth1 Twitter login, and user‑aware views, while explaining Play's reactive, asynchronous architecture for scalable backend development.

AuthenticationMongoDBPlay Framework
0 likes · 6 min read
Playful Web Development, Part 1: Managing User Authentication with Play Framework and Scala
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
May 10, 2015 · Backend Development

Migrating Whitepages Services from Ruby to Scala and Akka: Performance Gains and Lessons Learned

Whitepages migrated several high‑traffic services from a Ruby monolith to Scala running on the Akka actor framework, achieving dramatically lower latency and higher throughput while sharing the practical benefits, challenges, and best‑practice insights they discovered during the transition.

AkkaRubyScala
0 likes · 6 min read
Migrating Whitepages Services from Ruby to Scala and Akka: Performance Gains and Lessons Learned