What is Bytewax?
Bytewax is a machine learning platform focused on processing data and serving machine learning models through real-time directed acyclic graphs (DAGs) of processing steps that we call Swarms. Bytewax lets you deploy, run and manage Swarms that will receive data via the Bytewax Gateway or other connectors and make inferences/predictions via a machine learning model. Bytewax was developed specifically for facilitating real-time inference/prediction.
Let’s unpack some of that language around Gateway, Connectors, Swarms, and Bees. Swarms are directed acyclic graphs (DAGs) of individual functions that are referred to as worker Bees or Bees and Gateway and Connectors are endpoints or data connectors used to send and receive data.
To conceptualize this, you can think of data as flowing into the Gateway and then flowing through the Swarm with various steps (Bees) that change the data, send it down a different path in the Swarm or return the data back through the Gateway.
Data is sent to Bytewax via a Gateway and Swarms will ingest data from the Gateway and potentially return it to the Gateway or send it to another Gateway.
Users can send data to the Bytewax Gateway, via the Bytewax built connectors or they can build their own custom connectors
Bytewax provides an SDK and a platform for building and deploying Swarms. Once the Swarms are deployed on Bytewax they can be integrated with an application to start receiving data and making inferences/predictions.
To install Bytewax, simply install the package associated with the language you are using. For Python
pip install bytewax
Then reach out to the Bytewax team to get a cluster set up or for your user account.
Coming back to our Swarm diagram again, We will go into depth into each one of the components shown below in the documentation.
The Bytewax line denotes the items that are running on the Bytewax cluster. A Bytewax cluster is a group of compute nodes that are running Bytewax on top of them. Bytewax Private Cloud is the most common offering and that is a private cluster that we manage for our customers in the cloud of their choice.
Networking, Security & Privacy
To facilitate a secure environment, a Bytewax cluster is secured within a private network that can be peered to the users network. This provides the security customers need for sensitive data while providing the convenience of a cloud service.
Customers can specify the size of their cluster and this can be modified at any time with the addition or subtraction of nodes to the cluster. Within your cluster, individual bees can also scale independently. Bees share resources inside the cluster and to maintain the scalability of Bees your cluster will need to be sized to meet the throughput and load requirements.
Bytewax is installable with the Bytewax installation module. It can be installed and configured in under 30 minutes and have you ready to deploy Swarms.