Operations 9 min read

SREWorks v1.2 Unveiled: New Marketplace, Private Build & Data Boosts

SREWorks v1.2 introduces an extensible operations marketplace, supports private intra‑network source builds with configurable resources, enhances metric collection and data consumption via Logstash and Kafka, adds various optimizations, and provides upgrade instructions for seamless migration to the new version.

Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
SREWorks v1.2 Unveiled: New Marketplace, Private Build & Data Boosts

1. Application Marketplace

SREWorks team designed a market distribution mechanism similar to Helm/RPM repositories. The public marketplace can be built on any static storage service and supports cache acceleration; currently Alibaba Cloud OSS is supported, with MinIO/S3 planned.

Multiple SREWorks platforms can publish packages to the same market, and a platform can subscribe to multiple markets.

Users are encouraged to build private markets on top of the application marketplace for internal use, with more public applications to be added for plug‑and‑play usage.

2. Pure Intranet Source Build

The v1.2 iteration organizes source‑build dependencies, allowing users to select or replace resources for builds in isolated or special environments.

2.1 Base Source Build

Before running ./build.sh, environment variables can be set to change resource addresses; defaults are used if omitted.

# Container images
export SW_PYTHON3_IMAGE="python:3.9.12-alpine"
export MIGRATE_IMAGE="migrate/migrate"
export MAVEN_IMAGE="maven:3.8.3-adoptopenjdk-11"
export GOLANG_IMAGE="golang:alpine"
export GOLANG_BUILD_IMAGE="golang:1.16"
export DISTROLESS_IMAGE="sreworks-registry.cn-beijing.cr.aliyuncs.com/mirror/distroless-static:nonroot"

# Software repositories
export APK_REPO_DOMAIN="mirrors.tuna.tsinghua.edu.cn"
export PYTHON_PIP="http://mirrors.aliyun.com/pypi/simple"
export GOPROXY="https://goproxy.cn"
export MAVEN_SETTINGS_XML="https://sreworks.oss-cn-beijing.aliyuncs.com/resource/settings.xml"

# Binary tools
export HELM_BIN_URL="https://abm-storage.oss-cn-zhangjiakou.aliyuncs.com/lib/helm"
export KUSTOMIZE_BIN_URL="https://abm-storage.oss-cn-zhangjiakou.aliyuncs.com/lib/kustomize"
export MINIO_CLIENT_URL="https://sreworks.oss-cn-beijing.aliyuncs.com/bin/mc-linux-amd64"

# SREWorks built‑in packages
export SREWORKS_BUILTIN_PACKAGE_URL="https://sreworks.oss-cn-beijing.aliyuncs.com/packages"
...

2.2 Operations Application Source Build

When running helm install/upgrade, additional parameters can be passed to enable in‑network build and deployment of operations applications.

# Container images
--setglobal.artifacts.mavenImage="sreworks-registry.cn-beijing.cr.aliyuncs.com/mirror/maven:3.8.3-adoptopenjdk-11" \
--setglobal.artifacts.openjdk8Image="sreworks-registry.cn-beijing.cr.aliyuncs.com/mirror/openjdk8:alpine-jre" \
--setglobal.artifacts.openjdk11Image="sreworks-registry.cn-beijing.cr.aliyuncs.com/mirror/openjdk:11.0.10-jre" \
--setglobal.artifacts.openjdk11AlpineImage="sreworks-registry.cn-beijing.cr.aliyuncs.com/mirror/openjdk11:alpine-jre" \
--setglobal.artifacts.alpineImage="sreworks-registry.cn-beijing.cr.aliyuncs.com/mirror/alpine:latest" \
--setglobal.artifacts.nodeImage="sreworks-registry.cn-beijing.cr.aliyuncs.com/mirror/node:10-alpine" \
--setglobal.artifacts.migrateImage="sw-migrate" \
--setglobal.artifacts.postrunImage="sw-postrun" \
--setglobal.artifacts.python3Image="sreworks-registry.cn-beijing.cr.aliyuncs.com/mirror/python:3.9.12-alpine" \
--setglobal.artifacts.bentomlImage="sreworks-registry.cn-beijing.cr.aliyuncs.com/mirror/bentoml-model-server:0.13.1-py37"

# Software repositories
--setglobal.artifacts.apkRepoDomain="mirrors.tuna.tsinghua.edu.cn" \
--setglobal.artifacts.mavenSettingsXml="https://sreworks.oss-cn-beijing.aliyuncs.com/resource/settings.xml" \
--setglobal.artifacts.npmRegistryUrl="https://registry.npmmirror.com" \
--setglobal.artifacts.pythonPip="http://mirrors.aliyun.com/pypi/simple"

# Binary tools
--setglobal.artifacts.minioClientUrl="https://sreworks.oss-cn-beijing.aliyuncs.com/bin/mc-linux-amd64"
...

3. Data Platform Capability Enhancements

3.1 Metric Collection Improvements

Managed clusters now use metricbeat to collect Prometheus exporter metrics. Pods with labels sreworks-prometheus-scrape-metric: enable and sreworks-prometheus-io-scrape: enable are automatically discovered. Previously only Service label sreworks-telemetry-metric: enable was supported.

3.2 Data Consumption Improvements

A new logstash data service component enables multi‑pipeline distribution of operational data. v1.2 routes collected metric data to Kafka, allowing custom processing via the VVP platform.

4. Other Optimizations

Fix service not reclaimed after application uninstall.

Remove Python 2.7 dependency from code base.

Support custom namespace during operations‑application deployment.

Site search service now indexes instance detail pages.

Complete front‑end component documentation.

5. How to Upgrade to v1.2

Upgrade includes the base platform; pages may be unavailable for 5‑10 minutes.

User‑developed cloud‑native applications are unaffected (no restart), but traffic through the SREWorks gateway may be interrupted.

git clone http://github.com/alibaba/sreworks.git -b v1.2 sreworks
cd sreworks
./sbin/upgrade-cluster.sh --kubeconfig="****"
marketplaceUpgradeSREWorksintranet build
Alibaba Cloud Big Data AI Platform
Written by

Alibaba Cloud Big Data AI Platform

The Alibaba Cloud Big Data AI Platform builds on Alibaba’s leading cloud infrastructure, big‑data and AI engineering capabilities, scenario algorithms, and extensive industry experience to offer enterprises and developers a one‑stop, cloud‑native big‑data and AI capability suite. It boosts AI development efficiency, enables large‑scale AI deployment across industries, and drives business value.

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.