发布于 2014-12-24 00:28:29 | 197 次阅读 | 评论: 0 | 来源: 网友投递
Spring XD
Spring XD是一个统一的,分布式,可扩展的系统用于 data ingestion,实时分析,批量处理和数据导出。该项目的目标是简化大数据应用的开发。
Spring XD 今天发布两个更新版本,分别是 1.1 M2 和 1.0.3,其中 1.1 M2 包含如下改进:
Kafka based Message Bus. If Kafka is your middleware du jour, you will feel right at home.
Batching and compression support for RabbitMQ provides significantly increased effective message rate throughput.
Develop Processor modules using Project Reactor’s Stream API. The Stream API is based on the Reactive Streams specification that provides a standard for asynchronous stream processing with non-blocking backpressure. This allows you to use a functional programming model as the basis for processing event streams. Combined with XD’s support for Data Partitioning on the Message Bus, you can create very powerful distributed stream processing solutions.
Easily develop, test, and package custom modules. A parent pom bootstraps all the dependencies required for building a custom module and bundles your module and dependencies into a single uberjar file. There is also support for integration testing your module with JUnit using an embedded single node server.
Upload custom modules to the admin server over HTTP.
Role based authorization of REST endpoints give you control over “who can do what”.
File based authentication as a simple alternative to LDAP.
下一个版本是 1.1 RC1,而 1.0.3 是一个维护版本,主要是 bug 修复。
详细信息请看发行说明。
Spring XD 是一个统一的,分布式,可扩展的系统用于数据摄取,实时分析,批量处理和数据导出。该项目的目标是简化大数据应用的开发。