Paper deep dive
Autonomous Collaborative Learning Among an Ensemble of Tsetlin Machines with Consensus-Based Inference
Yehuda Rudin, Osnat Keren, Michal Yemini, Alexander Fish
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 91%
Last extracted: 7/23/2026, 2:00:06 AM
Summary
This paper proposes a decentralized collaborative learning paradigm for an ensemble of Tsetlin Machines (TMs) using consensus-based inference. The framework operates under a vertical feature-partitioning setting where agents maintain private models and do not exchange raw data. Instead, agents communicate with neighbors via an asynchronous gossip protocol to aggregate clause outputs and reach a global consensus. The architecture features a two-layer hierarchy: an input layer for local feature classification and a neighborhood aggregation layer for combining outputs from neighboring nodes. Experiments on MNIST, Fashion-MNIST, and synthetic sensor networks demonstrate that this decentralized approach achieves classification accuracies comparable to centralized models while preserving data privacy and accommodating heterogeneous agents.
Entities (15)
Relation Signals (12)
Proposed Framework → evaluatedon → MNIST
confidence 95% · We analyze the model’s performance, using software implementation, on the MNIST and Fashion-MNIST datasets
Proposed Framework → evaluatedon → Fashion-MNIST
confidence 95% · We analyze the model’s performance, using software implementation, on the MNIST and Fashion-MNIST datasets
Tsetlin Machine → usescomponent → Tsetlin Automaton
confidence 95% · Tsetlin Machine (TM) is a rule-based machine-learning algorithm comprising collectives of two-action Tsetlin Automata (TAs)
Osnat Keren → affiliatedwith → Bar-Ilan University
confidence 92% · Y.Rudin,M.Yemini,andA.FisharewithFaculty ofEngineering,BarIlanUniversity
Yehuda Rudin → affiliatedwith → Bar-Ilan University
confidence 92% · Y.Rudin,M.Yemini,andA.FisharewithFaculty ofEngineering,BarIlanUniversity
Michal Yemini → affiliatedwith → Bar-Ilan University
confidence 92% · Y.Rudin,M.Yemini,andA.FisharewithFaculty ofEngineering,BarIlanUniversity
Alexander Fish → affiliatedwith → Bar-Ilan University
confidence 92% · Y.Rudin,M.Yemini,andA.FisharewithFaculty ofEngineering,BarIlanUniversity
Tsetlin Machine → supportsmethod → Vertical Feature-Partitioning
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Tsetlin Machine (TM) is a rule-based machine-learning algorithm comprising collectives of two-action Tsetlin Automata (TAs) that cooperatively form conjunctive logical clauses from Boolean inputs through stochastic feedback. Although few recent studies have examined TM Federated Learning, the broader area of distributed and decentralized TM learning has not received much attention in the existing literature and warrants further exploration. In this work, we propose a paradigm for decentralized collaborative learning under a vertical feature-partitioning setting among an ensemble of Tsetlin Machines using consensus-based inference. Within this decentralized paradigm, each agent maintains its own private TM model, and there is no exchange of raw data among agents. Inference combines individual agents model predictions into a global consensus. The paradigm accommodates heterogeneous TM-based agents with differing data acquisition means, local data distributions, or computational resources, thereby facilitating the integration and fusion of information in settings such as multi-modal sensing environments. Experiments conducted using two-dimensional grid and connected graph network topologies demonstrate that the classification accuracies achieved are comparable to those of centralized models.
Tags
Links
- Source: https://arxiv.org/abs/2607.20124v1
- Canonical: https://arxiv.org/abs/2607.20124v1
Trouble viewing inline? Open PDF directly →
Full Text
64,831 characters extracted from source content.
Expand or collapse full text
Autonomous Collaborative Learning Among an Ensemble of Tsetlin Machines with Consensus-Based Inference Yehuda Rudin, Osnat Keren, Michal Yemini, and Alexander Fish Abstract—TsetlinMachine(TM)isarule-based machine-learning algorithm comprising collectives of two- action Tsetlin Automata (TAs) that cooperatively form conjunctive logical clauses from Boolean inputs through stochastic feedback. Although few recent studies have examined TM Federated Learning, the broader area of distributed and decentralized TM learning has not received much attention in the existing literature and warrants further exploration. In this work, we propose a paradigm for decentralized collaborative learning under a vertical feature-partitioning setting among an ensemble of Tsetlin Machines using consensus-based inference. Within this decentralized paradigm, each agent maintains its own private TM model, and there is no exchange of raw data among agents. Inference combines individual agents’ model predictions into a global consensus. The paradigm accom- modates heterogeneous TM-based agents with differing data acquisition means, local data distributions, or com- putational resources, thereby facilitating the integration and fusion of information in settings such as multi-modal sensing environments. Experiments conducted using two- dimensional grid and connected graph network topologies demonstrate that the classification accuracies achieved are comparable to those of centralized models. Index Terms—Machine Learning, Tsetlin Machine, Fed- erated Learning, Cooperative Learning, Collaborative learning, low-power compute. I. INTRODUCTION The Tsetlin Machine (TM), first introduced in 2018 [1], represents a logic-driven machine learning paradigm that serves as an alternative to Artificial Neural Networks (ANNs). Since its introduction, an extensive family of TM variants has emerged, including [2]–[15], each extending the capabilities of the core framework. The theoretical foundation of TM can be traced back to the work of Michael Tsetlin, who pioneered the con- cept of the learning automaton and formulated the theory of automata collective behavior [16]–[18]. According to the theory, intricate, system-level behavior can emerge from local interactions of agents following simple rules and performing a set of simple actions. Through local interactions alone, without any centralized controller, the Y.Rudin,M.Yemini,andA.FisharewithFaculty ofEngineering,BarIlanUniversity,RamatGan5290002, Israel.Emails:yehuda.rudin@biu.ac.il,osnat.keren@biu.ac.il, michal.yemini@biu.ac.il, alexander.fish@biu.ac.il. group can pursue and attain complex common goals that exceed the capabilities of any individual agent [19]. This emergent perspective underpins the design philosophy of the Tsetlin Machine. Concretely, TM builds on the Tsetlin Automaton (TA) and propositional logic; it uses collections of logical clauses constructed from Boolean input features to en- code and recognize patterns in data. These clauses, shaped through reinforcement-driven updates of the un- derlying automata, form interpretable logical expressions that capture relevant input–output relationships. Because its operations are grounded in discrete, logic- based computations rather than continuous-valued matrix operations, TM is inherently simple from a computa- tional standpoint and can be implemented efficiently in both software and hardware. This simplicity translates into reduced energy consumption [20]. Consequently, TM is particularly attractive for resource-constrained and energy-limited environments, such as embedded systems and edge computing platforms [21], [22]. Grounded in the framework of propositional logic, the TM’s under- lying decision-making process can be rationalized and explained by human-readable conjunctive clauses. Data-generating edge devices typically operate under strict constraints on both computation and energy. In these settings, it is also important to safeguard the privacy of locally collected data. Most machine learning methods rely on complex arithmetic operations and therefore consume substantial energy, posing barriers for edge devices, particularly during model training. One possible approach to circumvent this limitation is to delegate the computationally intensive tasks to cloud-based resources. However, this strategy introduces additional drawbacks, notably increased latency, higher energy expenditure associated with data transmission and network communication, and a compromise of privacy by uploading raw data to the cloud. Instead, it is desirable to perform learning and infer- ence in proximity to the data sources, exploiting and coordinating the local computational resources available at all participating agents. Federated Learning (FL) [23]–[25] is used when the data is physically distributed, e.g., generated from a arXiv:2607.20124v1 [cs.LG] 22 Jul 2026 network of sensors spatially spread, and when there is a need to preserve data privacy. FL offers a paradigm in which a central server orchestrates model training across a collection of devices. FL is typically classified into Horizontal Federated Learning (HFL) and Vertical Federated Learning (VFL) based on the data distribution between the participating agents [26]. In HFL, agents share the same feature set but have different samples, whereas in VFL, agents possess dif- ferent feature sets but the same sample set. In HFL, a shared model is trained across several agents. A central server coordinates the training by sending an initial model to the clients. Each client trains the model locally on its private data. The model updates (weight deltas, gradients) are sent back to the server, which aggregates them to improve the global model. The cycle repeats until the model reaches the desired performance. In the standard workflow, each agent uses the globally trained model independently for inference. In VFL settings, different agents typically hold differ- ent feature subsets for the same samples. Each agent has its own local sub-model that consumes its own features only and outputs an embedding or partial prediction. A central aggregation model (on a server or central agent) combines these embeddings to produce the final pre- diction. Knowledge Distillation-based approaches [27] have emerged as the most prevalent in this category, enabling knowledge transfer between models with dif- fering structures. Whereas conventional VFL paradigms restrict training to shared samples across participating parties, the approach proposed in [28] generalizes this framework by enabling each party to additionally exploit its own private, non-overlapping local samples via a dedicated knowledge transfer mechanism. VFL is designed for cross-silo environments where multiple parties possess data on the same set of users or entities but operate in distinct domains, are willing to cooperate, and do not have conflicting interests. It is particularly advantageous when data cannot be con- solidated into a single repository because of privacy constraints, regulatory requirements, or organizational barriers. Prominent VFL applications include collabora- tive healthcare analytics, banking, credit risk assessment, and e-commerce [29]. It is also employed to jointly train large-scale machine learning models in a distributed fashion [30]. Decentralized Federated Learning (DFL) [31] elimi- nates the central server; agents only communicate with their neighbors to reach a consensus model. DFL offers a communication advantage and further preserves data privacy. FedMD [32] is a heterogeneous federated learning method based on knowledge distillation. Every agent maintains its own private dataset and an individually tailored model. The information learned by each agent is converted into a common representation, which is then aggregated by a central server to derive a consensus that is shared back with the agents. Federated learning was proposed for the Tsetlin Ma- chine in [33]–[35], all of which use a central server for model aggregation. In this work, we investigate a TM-based decentralized learning framework under a vertical federated learning data partitioning scheme, wherein agents hold disjoint feature subsets of the same data instances and rely on peer-to-peer communication to achieve consensus-based prediction (inference). The agents may be diverse, such that each agent may have its own machine learning model, which is not shared with the other agents, thereby further increasing the heterogeneity of the learning process. Our novel approach is grounded in a two-layer hierar- chical TM architecture, to the best of our knowledge, the first of its kind, which is paired with a gossip- based communication protocol. This configuration en- ables agents to exchange information efficiently with their neighboring peers, while simultaneously preclud- ing the direct transmission of raw data and explicit model parameters, to safeguard the confidentiality of both (formal leakage analysis is left for future work). At the first layer of the hierarchy, which we name the “input layer”, the TM operates on locally available features and performs classification tasks using only this subset of features. At the second layer, which we name “the neighborhood aggregation layer”, the framework consolidates the rule-based outputs produced by each agent with those obtained from its neighboring agents. Through this aggregation over a cluster of interconnected nodes and an expanded, more heterogeneous feature space, the second tier can recognize and characterize more intricate input patterns that cannot be captured by isolated local models alone. The proposed architecture is presented in Fig. 1. Main contributions The main contributions of this work are as follows: • We introduce a hierarchical TM framework that enables distributed, decentralized learning under aligned samples and a vertical feature-partitioning setting with consensus-driven inference. This framework is designed to preserve the confidential- ity of both the underlying model parameters and the local data of each participant. • The proposed paradigm accommodates heteroge- neous TM-based agents with differing data acqui- sition means, local data distributions, or computa- tional resources, thereby facilitating the integration and fusion of information in settings such as large- TM TM Input Layer Neighborhood Aggregation Layer Dataset is composed of n x n partitions Clause outputs from neighboring nodes Input layer clause outputs Node vote sum Σ Global vote sum per class Propagated class vote sums from other nodes node’s input data 4.6 cm 10.2 cm Immediate neighbors Fig. 1: Architecture of an Agent. scale sensor networks and multi-modal sensing en- vironments. • We propose an inter-agent asynchronous gossip- based communication protocol for coordination and data exchange. • We analyze the model’s performance, using soft- ware implementation, on the MNIST and Fashion- MNIST datasets, partitioned among several agents. • We analyze the model’s performance on a synthetic heterogeneous sensor network setup, in comparison to a centralized ANN model. • We assess the sensor network model under two- dimensional grid and general connected graph net- work topologies. • We evaluate performance as a function of system configuration variants such as the number of agents (dataset partitions) and the TMs’ hyperparameters in each hierarchy. Organization The remainder of this paper is structured as fol- lows. Section I provides an introduction to TM and reviews previous work related to FL using TM, Section I describes the proposed algorithm for collaborative decentralized TM learning, and Section IV presents performance results over the MNIST handwritten digit recognition benchmark, the Fashion-MNIST benchmark, and a heterogeneous sensor network model. Section V summarizes this work. I. TECHNICAL BACKGROUND This section outlines the architecture of the TM model, explains the core principles underlying its operation, and specifies its hyperparameter definitions. In addition, it presents techniques used in distributed machine learning settings. A. TM Overview A block diagram of TM is presented in Fig. 2(a). The Tsetlin Machine (TM) performs classification of input features by employing conjunctive clauses to detect discriminative patterns. The input space is represented by Boolean features together with their complements, collectively referred to as literals. Half of the clauses (positive clauses) are dedicated to recognizing patterns associated with the target class, whereas the remaining clauses (negative clauses) are responsible for identifying patterns indicative of non-membership in the target class. The final classification decision is obtained by sum- ming the outputs of the positive and negative clauses, taking into account their respective signs, and comparing the resulting aggregate score to a predefined threshold. This procedure effectively implements a voting mecha- nism over the set of clauses. Each clause is associated with a team of Tsetlin Automata (TAs), with one automaton assigned to each literal. A TA is a finite-state machine (FSM) employed to construct logical clauses through the inclusion or exclusion of literals. Depending on its current state, a (a) (b) 6.71cm TM_TA S1S2S3S4S5S6 Reward Penalty ACTION1ACTION2 Inaction Clause C onstruction Clause C onstruction TA Teams TA Teams Clause C onstruction - + Positive Conjunctive Clauses Negative Conjunctive Clauses Σ Summation and Thresholding Learning Feedback Include/ Exclude Penatlties/ Rewards Ŷ (Output/ Prediction) Y (Expected Output/Label) TA Teams (a team per Clause, TA per literal) S1 S2 S n-1 Sn S1 S2 S n-1 Sn S1 S2 S n-1 Sn S1 S2 S n-1 Sn Fig. 2: The Tsetlin Machine. (a) Block Diagram of a Tsetlin Machine. (b) State diagram of Tsetlin learning Automaton (6-state example) TA chooses between two possible actions: Include or Ex- clude. For every action executed, the Learning Feedback module produces either a Reward, Penalty, or Inaction, following a probability distribution that depends on the specific literal assigned to the automaton as well as the relationship between the clause output and the expected output. The TA updates its internal state in response to this feedback to rapidly converge to the action associated with the highest reward probability. Figure 2(b) depicts an example of a TA comprising six states. A Tsetlin Machine is characterized by two principal hyperparameters, denoted by T and s. The threshold parameter T regulates the target magnitude of the aggre- gate clause vote. Consequently, a higher threshold value entails that a greater number of clauses contribute to the voting process and thereby affect the feedback dynamics governing the TA states. During the training phase, the probability of issuing feedback increases as the deviation of the clause vote from the threshold T grows. In contrast, when the clause vote reaches or surpasses the threshold T , the feedback mechanism is effectively suppressed and no further feedback is provided. The hyperparameter s regulates the probability with which TAs transition between internal states. It controls the sensitivity (Specificity) of the learning process. A high value of s promotes the learning of specific patterns by forming specialized clauses, while a low value of s generates more general clauses. Careful tuning of these parameters can be used to determine learning stability and robustness [1]. As illustrated in Fig. 2(b), a TA updates its state in response to one of three possible forms of feedback: Reward, Penalty, or Inaction. Two distinct feedback mechanisms are defined within the TM learning frame- work: Type I feedback and Type I feedback, which are specified in Table I and Table I, respectively. TABLE I: Type I Feedback Clause10 Action Literal1010 P(reward) s−1 s -00 P(inaction) 1 s - s−1 s s−1 s Include Literal P(penalty)0- 1 s 1 s P(reward)0 1 s 1 s 1 s P(inaction) 1 s s−1 s s−1 s s−1 s Exclude Literal P(penalty) s−1 s 000 Type I feedback reinforces true positive output (Type Ia feedback) and reduces false negative output (Type Ib feedback). When the clause outputs ”1” for the target class, if a TA action is to include a literal valued ’1’, it receives reward feedback with probability s−1 s , otherwise “inaction” occurs with a probability of 1 s . If the TA action, in this case, is to exclude a literal valued ’0’, it receives a reward feedback with probability 1 s , otherwise, “inaction” occurs with a probability of s−1 s . In case the clause outputs ’0’ for the target class, the feedback is directed to combat the false negative output. Given the need for clause reconstruction, the feedback penalizes all inclusions while rewarding all exclusions. Type I feedback is activated when the clause outputs ’1’ for a pattern that does not belong to the target class. In this case, the exclusion of a literal that is ’0’ is penalized. TM has been shown to be effective in image clas- sification [2], IoT applications [21], [22], [36], low- power speech recognition [37], and Natural Language Processing (NLP) [38]–[41]. TABLE I: Type I Feedback Clause10 Action Literal1010 P(reward)0-00 P(inaction)1-11 Include Literal P(penalty)0-00 P(reward)0000 P(inaction)1011 Exclude Literal P(penalty)0100 For reference, Table I, reproduced from [42], shows the MNIST and Fashion-MNIST test accuracy results, comparing classic TM with various machine learning algorithms. A comparative analysis of TM to Neural Networks regarding learning convergence and energy efficiency is presented in [20]. TABLE I: Test accuracy in percent for TM and selected popular machine learning algorithms, adapted from [42]. ModelMNISTF-MNIST 4-Nearest Neighbors97.1485.40 SVM98 .5789 .7 Random Forest97 .381 .6 Gradient Boosting Classifier96 .988 .0 Simple CNN99 .0690 .7 Binary Connect98 .99– FPGA accelerated BNN98 .70– Logistic Circuit (binary)97 .487 .6 Logistic Circuit (real-valued)99 .491 .3 PreActResNet-1899 .5692 .00 ResNet18 + VGG Ensemble99 .60– TM98.5790.09 B. Federated Learning with Tsetlin Machine Inspired by conventional Federated Learning with Convolutional Neural Networks (CNNs), FedTM [33] is a framework that uses Tsetlin Machine in FL. As in HFL, all FedTM clients use a global model. The server performs aggregation in two steps: aggregation of clause weights (AverageCW) and aggregation of clause states (TopK). AverageCW calculates the weighted average of integer clause weights for each class across the participating J clients, based on their dataset sizes. TopK aggregates the states from a subset of K clients for a spe- cific class. The states are selected from clients with the highest number of samples per class, indicating greater confidence, and are combined using the bitwise OR operator. Compared to conventional Federated Averaging (FedAvg) with CNNs, on average, FedTM provides a substantial reduction in communication costs by 30.5× and 36.6× reduction in memory footprint. Tsetlin-PersonalizedFederatedLearningwith Confidence-BasedClustering(TPFL)[35]was introduced to tackle a key challenge in federated learning (FL): the heterogeneity of data distributions across clients. In this approach, a client’s model parameters are aggregated only when the client is sufficiently confident in what it has learned, meaning it has seen enough training samples for a given class. This notion of confidence is derived from the voting mechanism of the Tsetlin Machine (TM) algorithm: a larger number of votes in favor of a class indicates higher confidence in the corresponding prediction. Each client transmits to the server its weight vector along with the label of the class for which it has the highest confidence. This substantially lowers the communication overhead. The server then partitions the clients into K clusters, where cluster k consists of those clients whose maximum confidence score is associated with class k. Within each cluster k, the clients’ weight vectors are aggregated. One-Shot Federated Learning With Tsetlin Machine, FedTMOS [34], restricts communication with the server to a single round, thus minimizing communication errors and reducing the risk of interference caused by iterative updates. Given J clients, each having local datasets D 1 ,D 2 ,...,D J . The objective is to aggregate local TM models, T = T 1 ,T 2 ,...,T J , into φ server models (φ < J ) that generalize well over all datasets in one communication round. The aggregation of the models is done by applying the principles behind TM Composites [43]. In the initial step, clients upload their scaled clause weights, which are adjusted based on the proportion of samples per class relative to the client’s total sample size. Alongside these weights, clients also upload their individual normalized Gini index, which quantifies the inequality in their local data distributions. The server then rescales the weights using the mean normalized Gini Index and performs k-means clustering on the weights. This inter-class weight separation technique is applied to create models that enhance class distinction. Finally, the φ server-side models are initialized, and class weights from each cluster are reassigned to maximize inter-class separation within each model. C. Motivation The TM has been introduced as an alternative learning architecture grounded in logic-based, bit-level operations that naturally map to hardware implementations. Due to its reliance on simple, low-complexity computations rather than continuous-valued arithmetic, the TM is particularly well suited to severely resource-constrained and energy-limited environments, including dense sensor networks and other edge-computing scenarios. Several works on TM-based federated learning have recently been published [33]–[35], however, the domain of dis- tributed and decentralized TM learning has, to a large extent, remained unexplored and has received minimal attention in the current literature. In this work, we consider a model-heterogeneous decentralized learning setting, where agents may employ different local model architectures and collaborate without exposing the local data or the underlying model. We assume that training samples are vertically aligned and that the class labels are available to all agents. I. ALGORITHM DESIGN The proposed distributed and decentralized learning algorithm is defined over an underlying undirected, fixed-in-time, and connected communication graph. The experimental evaluation in this study primarily considers a two-dimensional cellular lattice of size n × n, in which each cell contains a single agent and is connected to its immediate eight neighboring cells. To eliminate boundary artifacts arising from agents having fewer than eight immediate neighbors, we consider a toroidal wrap-around grid. In addition, we assess the algorithm’s performance on a more general graph network topology. Each agent (for instance, a sensor node in a distributed sensor network) acquires and processes its own local dataset, which remains strictly private and is never directly shared. During both the training (learning) phase and the prediction (inference) phase, agents cooperate only with their immediate neighbors in the grid topology, exchanging information in a way that does not reveal their underlying private models. The collective objective during inference is for the distributed ensemble of agents to arrive at a shared, globally consistent decision or estimate, i.e., to achieve consensus across the entire grid. Our proposed architecture is organized as a two-layer hierarchy, where each layer contains a TM, as depicted in Fig. 1. The TM in the first layer (the Input Layer) operates directly on the Boolean input features. During the learning phase, it forms clauses that specialize in recognizing particular patterns present in these input features. The TM in the second layer (Neighborhood Aggre- gation Layer) receives, as its input, the outputs of the clauses from the first-layer TM associated with its own cell, together with the clause outputs originating from the eight nearest neighboring cells. Based on this combined input, the Neighborhood Aggregation Layer TM learns to detect higher-level, more global response patterns emerging from the local cluster comprising the cell itself and its nearest neighbors. In a multi-class classification scenario, each agent maintains a pair of TMs for every class. As empirically demonstrated in Section IV, the pro- posed aggregation layer yields superior performance relative to simpler, non–learned aggregation strategies, such as voting-sum aggregation. In particular, the clause- output states exhibit a stronger and more precise correla- tion with the clusters’ input features than those produced by the aggregated voting sum. The aggregation-layer TM effectively learns the activity patterns of the clauses within the cluster. Crucially, only the binary clause outputs are ex- changed between neighboring cells, while the internal structure and composition of the clauses remain private and are not revealed. Because each clause output can be encoded as a single bit, the communication overhead be- tween neighbors is kept very low, substantially reducing the volume of data that needs to be transmitted. A. Distributed Learning The complete training workflow is detailed in Al- gorithm 1. The training of an agent is carried out in two distinct stages. In the first stage, the Input Layer TM is trained exclusively from the Boolean feature representation provided as input (lines 6, 7). During the second stage, the Neighborhood Aggregation Layer TM is trained (line 10) while the Input Layer TM, as well as the Input Layer TMs of neighboring agents, are kept in inference mode, thereby supplying their outputs as input signals. The Input Layer clause outputs of the nearest neighbors are gathered (lines 8, 9) via a dedicated communication protocol, the details of which will be presented and analyzed in Section I-B. In a multi-class classification scenario, each agent maintains a pair of TMs for every class. For a given training instance, the TM pair (consisting of the Input Layer and the Neighborhood Aggregation TMs) associ- ated with the instance’s ground-truth label is updated first (lines 6-10). After this label-specific update, the training step is repeated for another pair of TMs corresponding to a different class (lines 11-15), which is selected at random but known to all agents. This sequence of operations defines a single training iteration for the agent. B. Inter-Agent Communication Inter-agent communication is employed both to coor- dinate agents’ activities and to transfer necessary data for processing. In the context of distributed edge computing, the design of the underlying communication protocol becomes a key architectural concern, because the energy overhead associated with transmitting and receiving data typically exceeds the energy cost of performing the computations themselves [44]. Our model assumes a wireless (or other shared media) communication setting where a single transmission can be overheard by multiple nodes. We employ a gossip random broadcast scheme, akin to that presented in [45] (nodes asynchronously broadcast to their neighbors when information is ready). The broadcast mechanism enables an agent to dissem- inate information to all of its neighboring nodes in Algorithm 1 Algorithm: Node’s Learning Procedure. Notations 1: INP c i - Input Layer TM of node i, class c 2: AGR c i - Aggregation Layer TM of node i, class c 3: N - Number of classes Require: input features,classlabels, altclasslabels 4: for all examplesinputfeatures,classlabel do 5:Initialize the local record of INP c i clause outputs for c=1,2,..,N and ∀i∈ node’s nearest neighbors Select and train a TM pair according to the class label 6:update INP class label i for current input 7:calculate INP classlabel i clause outputs 8:broadcast INP class label i clause outputs to nearest neighbors 9:receive and record INP classlabel j clause outputs ∀j ∈ neighbors(i) 10:update AGR class label i using acquired input layer clause outputs related to classlabel Train a TM pair of a different class. The different class label is known to all agents 11:update INP alt classlabel i for current input, altclasslabel̸= classlabel 12:calculate INP altclasslabel i clause outputs 13:broadcast INP altclasslabel i clause outputs to nearest neighbors 14:receive and record INP alt classlabel j ,∀j ∈ neigh- bors(i) 15:update AGR alt classlabel i using acquired input layer clause outputs related to alt classlabel 16: end for a single transmission, thereby accelerating convergence and reducing communication overhead. Furthermore, the use of an asynchronous protocol ensures that each agent operates autonomously, with less dependency on other nodes. This obviates the necessity for a globally synchro- nized master clock and mitigates delays or bottlenecks associated with synchronization, allowing the system to function in a decentralized and temporally flexible manner. 1) Clause Outputs Update: After training its Input Layer TM for the given example, the agent calculates the output of the corresponding Input Layer TM clauses. Then it broadcasts these output values to its immediate neighboring agents located within its connectivity radius. Messages are tagged with sample identifiers to ensure that clause outputs correspond to the same training instance. Each clause output can be encoded as a single bit, substantially reducing the volume of data that needs to be transmitted. All agents that successfully receive this communication accordingly update their internal state. Once the originating agent has collected the updated information from each of its nearest neighbors, it initiates the training procedure for its Neighborhood Aggregation Layer TM. However, if any communication packet is lost during this exchange, the agent may omit the Neigh- borhood Aggregation Layer TM training phase for that cycle. 2) Class Vote Sum Update: Algorithm 2 presents the procedure executed by each agent. For class prediction (inference), each agent’s local class vote sums need to be disseminated to all other agents, so that a network- wide consensus on the predicted class can be achieved. In this context, consensus denotes a state in which every agent possesses complete information regarding the vote sums of every other agent, such that each node can compute an identical, globally consistent class decision. To accomplish this, we apply a multi-source, all-to-all dissemination protocol. Each node maintains a vote-sum table that contains one entry for every node in the grid. At the beginning of the procedure, each node transmits its own current vote sum to its eight immediately adjacent neighbors (line 11). When a node receives a message, it updates the corresponding entries in its local vote-sum table with the newly obtained values (lines 12-21). Furthermore, whenever a node acquires previously unknown vote- sum information, it propagates this new information by broadcasting it to its nearest neighbors (gossip with aggregation) (lines 22-24). A given node can obtain iden- tical data from several independent upstream sources. This redundancy may improve the resilience of the protocol to communication impairments, for example, in the presence of packet loss, intermittent connectivity, or transient link failures, the likelihood that the node still receives the required information remains high. The impact of communication impairments was not evaluated in this study and is deferred for future work. Through repeated local exchanges of this kind, the complete set of vote sums is gradually diffused throughout the grid, enabling all agents to converge on a shared global decision. Assuming reliable delivery and a fair scheduler, all agents become fully informed of all values in Θ(n) time. The total number of broadcast events is Θ(n 2 ) (every agent has to transmit at least once) [46]–[48]. IV. EXPERIMENTATION In the initial assessment of our distributed ML model, we operate under the assumption of ideal communica- tion among all agents; consequently, practical network Algorithm 2 Class Vote Sum Update (Executed by Node i for each class) 1: Local state: 2: T [1 : n 2 ]▷ Vote-sum table 3: Known ▷ Set of node IDs with known vote sums 4: vote i ▷ Local vote of node i 5: Initialization: 6: for v = 1 to n 2 do 7: T [v]← null 8: end for 9: T [i]← vote i 10: Known←i 11: broadcast (i,vote i ) to neighbors(i) 12: Upon receiving message M : 13:▷ M contains (node id, votesum) tuples 14: NewInfo←∅ 15: for all (v,s)∈ M do 16:if T [v] = null then 17:T [v]← s 18:Known← Known∪v 19:NewInfo← NewInfo∪(v,s) 20:end if 21: end for 22: if NewInfo̸=∅ then 23:broadcast NewInfo to neighbors(i) 24: end if 25: Local completion condition: 26: Node i is fully informed when |Known| = n 2 imperfections such as packet loss, delays, or message corruption are not yet incorporated into the analysis. For empirical evaluation, we employ the MNIST dataset of handwritten digits as well as the Fashion-MNIST dataset. The distributed computational architecture is orga- nized as an n×n two-dimensional lattice, yielding a total of n 2 agents. Each image from the datasets is spatially partitioned into n 2 equally sized tiles, with each tile uniquely assigned to one agent in the grid. All agents share the same TM hyperparameters (number of clauses, threshold T , and specificity parameter s), ensuring a homogeneous configuration at the architectural level. Nevertheless, each agent’s internal model is adapted to the local data it receives and thus learns to detect and classify patterns that are characteristic of the particular image tile for which it is responsible. A. MNIST Benchmark The MNIST dataset [49] is composed of images with a resolution of 28×28 pixels. Classification performance on this dataset is reported for two distinct experimental setups. In the first setup, the system is composed of 49 agents, where each agent is responsible for processing a 4× 4 pixel subregion (tile) of the original image. In this configuration, each tile covers approximately 2.05% of the entire image area. The collective decision of the ensemble of 49 participating agents is then used to assign a class label to the complete image. Fig. 3 presents the vote patterns of the 49 agents associated with the class representing the digit “7” and of those associated with the class representing the digit “2” for two images. The number in each tile is the agent’s vote for that tile. In the first experiment, an image of a handwritten 7 is provided as input, whereas in the second experiment, the input is an image of a handwritten 2. As the chart shows, the aggregated class-wise vote sum serves as a robust discriminator, reliably separating the true class from competing classes. Exper.ClassDigit “7”Digit “2” 1 Agents’ votes on the presented image (digit “7”) Class Sum187-106 2 Agents’ votes on the presented image (digit “2”) Class Sum-189129 10.4 cm 0 055552 3455555 5555552 4555543 0555552 0455530 0555510 0-1-4-4-5-5 -3-4-3 -4-5-1-3 -1-2-1-3-3 -5-5-4-5 -1-5-5-4-5 -5-5-5-4 0 1 0 00 00 00 0 0 0 0 0 11 1 0 0245340 0 00 03114 2353 04411 355304 5555253 5555545 -2 -4 -1 -2 4 0 0 0 0 0 0 -5-5-5-5-5 -5-5-5-5-5 -5-5-5-5-5 -5-5-3-4-4-1 -5-5-5-5-5-5-1 -5-5-5-5-5-5-1 -1-5-5-5-5-5-5 1 Fig. 3: MNIST benchmark: Class vote sums. The number in each tile is the agent’s vote for that tile. Table IV reports the test accuracies obtained after 50 training epochs by an ensemble comprising 49 agents, where each agent is responsible for learning a 4×4 image patch. The table reports test accuracy results obtained from single-layer and two-layer agent architectures. The performance of the two-layer architecture is substantially better than that of a single layer. The results are shown for multiple architectural settings of both the Input Layer TM and the Neighborhood Aggregation TM, enabling a comparison of performance across different configura- tion choices. Table V presents the test accuracies obtained after 50 training epochs by an ensemble comprising 16 agents, where each agent is responsible for learning a 7×7 image tile. In this setup, each agent learns a tile that contains 6.25% of the whole image. The table reports test ac- curacy results obtained from single-layer and two-layer TABLE IV: MNIST test accuracy. 49 agents, each learns a 4× 4 image tile. A tile contains 2.05% of the whole image. Input layerAggregation Layer Epochs Accuracy [%]ClausesTsClausesTs 16310 vote sums20 89.23 3241089.94 6461090.80 12882090.86 163332410 50 92.63 16334851092.90 16336441093.60 32333241093.21 32334851093.84 32336461094.40 Accuracy of a classic TM with 200 clauses, T=10, s=7,5, is 96.73% @100 epochs [50]. TABLE V: MNIST test accuracy. 16 agents, each learns a 7× 7 image tile. A tile contains 6.25% of the whole image. Input layerAggregation Layer Epochs Accuracy [%]ClausesTsClausesTs 16310 vote sums20 89.61 3241091.40 6461090.80 12882093.63 164516310 50 92.65 16453241093.76 16456461093.88 32453241094.12 32454851094.60 32456461094.65 Accuracy of a classic TM with 200 clauses, T=10, s=7.5, is 96.73% @100 epochs [50]. agent architectures, showing the superior performance of the two-layer architecture. B. Fashion-MNIST Benchmark The Fashion-MNIST dataset [51] consists of images with a resolution of 28 × 28 pixels, depicting items from 10 distinct categories of apparel (such as T-shirts, trousers, and bags). We begin by analyzing the behavior of an ensemble model composed of 49 agents, where each agent processes a dedicated 4× 4 pixel patch of the input image, corresponding to 2.05% of the entire image area. For the 49-agent Fashion-MNIST setup, Fig. 4 illus- trates the voting behavior of the agents for three specific classes (pullover, shirt, and ankle boot), along with the resulting aggregated class scores, for two example input images: a Pullover and an ankle boot. The number in each tile is the agent’s vote for that tile. In both examples, the correct class label is clearly identifiable from the overall class sum, which stands out relative to the competing classes. For the pullover input, the Shirt class also attains a positive cumulative vote, reflecting the visual similarity TABLE VI: Fashion-MNIST test accuracy. 49 agents, each learns a 4× 4 tile. A tile contains 2.05% of the whole image. Input layerAggregation Layer Epochs Accuracy [%]ClausesTsClausesTs 16310 vote sum20 74.89 3241075.69 6461074.96 12881076.86 163332410 50 80.75 16334851081.34 16336461081.64 32333241082.11 32334851082.41 3233646103583.85 Accuracy of a classic TM with 500 clauses, T=20, s=7.5, is 87.75% @100 epochs [50]. between shirts and pullovers in the dataset (e.g., similar silhouettes or overlapping features). Nevertheless, the pullover class still exhibits a substantially higher class sum than the shirt class, indicating that the ensemble is able to correctly disambiguate between these two visually related categories. Class/ Presented image Pullover (2) Shirt (6) Ankle Boot (9) Class Sum21320-224 -235-225138 5.11 cm 5554555 5533545 555 555 55555 555 5555555 2244 1343 443 33 4 -1-2-1 -2-2-1 -1-3 -2 -1-3-2 -3-3 -1400101 2142 4402 20221 001132 2421 104-2-3 -5-1-4-5-5-5-5 -5-5-4-5-5-5-5 -5-4-4-5-5-5-5 -5-5-2-3-5-5-5 -5-2-4-5-5-5-5 -5-5-5-2-5-4-5 -5-5-5-5-5-5-5 -5-5-5-5-5-5-5 -5-5-5-5-5-5-5 -5-5-5-5-5-5-5 -5-5-4-5-30-5 -1-5-5-5-5-5-5 -2-4-5-4-5-5-5 -5-5-4-4-4-5-5 -5-5-5-5-5-5 -5-5-5-5-5-5-5 -5 -5-4-5-4-5-5-5 -5-5-5-5-4-4-5 -5-5-5-5-2-5-5 -5-5-5-5-5-5-5 -5-5-3-5-5-5-5 0010410 11233 3021555 5355555 5555555 5551342 3320023 -3-1 Fig. 4: Fashion-MNIST benchmark: agents’ voting be- havior for 3 classes. The number in each tile is the agent’s vote for that tile. Table VI summarizes the test accuracies achieved for the Fashion-MNIST dataset after 50 training epochs by an ensemble of 49 agents, with each agent dedicated to modeling a distinct 4×4 image patch. The table presents results for several architectural parameters of both the Input Layer TM and the Neighborhood Aggregation TM. Table VII summarizes the test accuracies achieved for the Fashion-MNIST dataset after 50 training epochs by an ensemble of 16 agents, with each agent dedicated to modeling a distinct 7×7 image patch. The table presents results for several architectural parameters of both the Input Layer TM and the Neighborhood Aggregation TM. TABLE VII: Fashion-MNIST test accuracy. 16 agents, each learns a 7× 7 image tile. A tile contains 2.05% of the whole image. Input layerAggregation Layer Epochs Accuracy [%]ClausesTsClausesTs 16310 vote sum20 79.11 3241080.45 6461081.02 12882082.94 163316310 50 80.24 16333241081.25 16336461082.96 32333241083.05 32334851083.63 32336461083.99 Accuracy of a classic TM with 500 clauses, T=20, s=7.5, is 87.75% @100 epochs [50]. C. Sensor Network In this experiment, we model distributed learning across a sensor network with heterogeneity in sensor data. The setup employs 25 agents arranged in a 5× 5 two- dimensional lattice. The class semantics (3 classes) are common to all agents; however, the mapping of sensor data to those classes differs across clients. Feature distribution heterogeneity is applied by: • Agents having one or two sensors (structural het- erogeneity). • Sensors having different scaling depending on the agent id (sensor 0: ×1.8/1.0, sensor 1: ×0.6/1) • Sensor 0 having different offset depending on agent id (1.2/none) • Different noise levels on sensor 0 and 1 (zero mean, std 0.3/0.4/0.8) For each class, the dataset is generated by sampling a base mean uniformly from [−1, 1]. The variance pa- rameters are independently sampled from [2, 3], and the resulting values are used to generate samples from a mul- tivariate Gaussian distribution. A sensor-heterogeneity model is then applied to introduce agent-specific adap- tations and capture inter-agent variability in the sensing process. Fig. 5 presents the distribution of sensor data for 9 agents. 1) Classification by ANN: Due to the overlap between classes, per-agent classification yields low accuracy. Ta- ble VIII presents the performance obtained using ANN to classify agent2 data samples. The per-agent accuracy ranged from 43% to 57.5%. The architecture of the ANN used is: Input(2)→ Dense(128,ReLU )→ Dense(64,Relu)→ Output(3,Softmax) Since each agent is just a relatively small, noisy sample from that global distribution, training on a sin- gle agent’s sample set cannot recover the full decision boundary. The aggregation of samples from all 25 agents was then used to train an ANN model with the following architecture: Input(45)→ Dense(256,ReLU )→ Dense(128,Relu)→ Dense(64,ReLU )→ Output(3,Softmax) The combined model learns a population-level rule across agents with an accuracy of 93%. The significant difference between local and global separability is pre- sented in Table VIII. 2) Classification by TM Ensemble: The sensor mea- surements are inherently analog quantities that can be modeled as real-valued variables. Since the TM oper- ates on Boolean-valued input features, these continuous variables must first be transformed into a discrete binary representation. To achieve this, the continuous value range of each feature is partitioned into a predefined number of bins. The binarization strategy adopted in this study deter- mines the bin thresholds via an order-statistic–based procedure, implemented as approximately evenly spaced selections from the sorted list of unique observed values. Concretely, all unique feature values are first extracted and sorted; the smallest unique value is then discarded, and the remaining unique values serve as threshold candidates. From this ordered set, thresholds are chosen at approximately uniform index intervals, yielding an approximation to Quantile Binning [52]. Under ideal Quantile Binning, the continuous data range is partitioned into a given number of bins such that each bin contains approximately the same number of samples. Relative to binning schemes based on fixed, a priori thresholds (e.g., uniformly spaced in the value domain), quantile-based binning is generally more robust for skewed or otherwise non-uniform data distributions, as it promotes a more balanced allocation of samples across bins. Each feature value is subsequently encoded in a cu- mulative (monotone) binary fashion with respect to the bin thresholds. For example, if the value range is divided into four bins defined by three thresholds, t1 < t2 < t3 , the feature value x is encoded in three bits: (x≥ t1), (x≥ t2), (x≥ t3) . Each sensor sample is binarized to 8 bits (for a two- sensor agent) or 16 bits (for a single sensor agent). a) A grid topology: The 16-bit input feature vector for each agent is first reshaped into a 4×4 tile. A total of 25 such tiles (one per agent) are then arranged in a 5× 5 two-dimensional lattice. Fig. 6 shows several randomly selected examples of the resulting 20× 20 patterns, each 012 Class 10 5 0 5 10 Sensor value Global sensor mean with min-max capped ranges per class global_raw.csv Sensors c0_sensor_0 c0_sensor_1 c1_sensor_0 c2_sensor_0 c2_sensor_1 c3_sensor_0 c3_sensor_1 c4_sensor_1 c5_sensor_0 c5_sensor_1 c6_sensor_0 c6_sensor_1 c7_sensor_0 c8_sensor_0 c8_sensor_1 Fig. 5: Sensor data distribution for 9 agents. representing the global feature set (all 25 agents). When data from all agents are pooled, a global class structure emerges in the 2D feature space. Class 0Class 1Class 2 18.2 cm 3.1cm 11111111111111111111111111111111111111111111111111111 111111111111111111111111111111111111 1111111111111111111111111111111111111111111111111111 111111111111111111111111111111 11111111111111111111111111111111111111111111 1111111111111111111111111111 11111111111111111111111111111111111111111111111 111111111111 111111111111111111111111111111111111111111111111111111 1111111111111111111111111111 11111111111111111111111111111111111111111111111111 1111111111111111111 1111111111111111111111111111111111111111111111111 1111111111111111111111 11111111111111111111111111111111111111111111111 111111111111111111 111111111111111111111111111111111111111111111111111111 1111111111111111111 111111111111111111111111111111111111111111 11111111111111111 1111111111111111111111111111111111111111111111111111111111 11111111111111111111111111111111111 111111111111111111111111111111111111111 11111111111111111111 11111111111111111111111111111111111111111111111111 11111111111111111111111 111111111111111111111111111111111111111111 111111111111111111111 1111111111111111111111111111111111111111111111111111 111111111111111111111111111111 1111111111111111111111111111111111111111 111111 111111111111111111111111111111111111111111111111111111 1111111111111111111111111111111111 1111111111111111111111111111111111111111111 111111111111 111111111111111111111111111111111111111111111 11111111111111 1111111111111111111111111111111111111111111111111111 1111111111111111111111111111 1111111111111111111111111111111111111111111111 11111111111111111111111 11111111111111111111111111111111111111111111 111111111111111111 111111111111111111111111111111111111111111111111 111111111111111111111 11111111111111111111111111111111111111 1111111 111111111111111111111111111111111111111111111111111 11111111111111111 111111111111111111111111111111111111111111111 1111111111111111111111 11111111111111111111111111111111111111111111111 11111111111111111 111111111111111111111111111111111111111111111 1111111111111111111 111111111111111111111111111111111111111111111111111111111 1111111111111111111111111111111 11111111111111111111111111111111111111111111 111111111111 Fig. 6: Visualization of the binarized input featues. 3 random frames for each class. In our setup, each of the 25 agents employs an Input Layer TM with 32 clauses and hyperparameters T=3, s=3. The Aggregation Layer TM is of 16 clauses and hyperparameters T=4, s=10. As reported in Table VIII, the TM ensemble achieves 93% accuracy, the same level of accuracy achieved by the centralized ANN model. The classifier leverages the global class-conditional structure across agents, which yields substantially higher accu- racy on the pooled dataset than on individual agents. The chart in Fig. 7 shows classification accuracy as a function of the number of participating agents for both the centralized ANN and distributed TM models. As the number of participating agents increases, the accuracy of the distributed TM progressively converges toward that of the centralized ANN. 16.2 cm 8.4cm 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1491625 Accuracy #Agents Accuracy vs. # Agents Centralized ANN Distributed TM Fig. 7: Classification accuracy as a function of the number of participating agents. Table IX presents the resources used by each agent and the overall system in comparison to a baseline single TM. While each local TM is relatively small, the total number of clauses and automata in the entire system exceeds that of a single traditional TM baseline. Nevertheless, a system made up of multiple small agents can achieve the same classification accuracy by utilizing their private, non-overlapping local samples. b) Connected graph topology: To assess the perfor- mance of the algorithm on a more general graph topol- ogy, as opposed to the regular n× n two-dimensional lattice, we consider the network topology illustrated in TABLE VIII: 25-agent sensor network. Comparison between centralized ANN and collaborative TM learning. Model ANN Single agent (agent 2) ANN Aggregated data from 25 agents TM Collaborated Learning of 25 agents Class012012012 Support808080200020002000200020002000 Accuracy0.500.930.93 Precision0.490.510.510.900.900.990.920.890.99 Recall0.310.460.740.900.900.990.890.920.99 F10.380.48600.900.900.990.900.900.99 Confusion Matrix 2525301801194517732189 1637271911802715218408 10115971519786121982 TABLE IX: Per-agent and system-wide TM resources for the sensor network example. ClausesTsLiteralsTAs System-wide instances per class System-wide # TAs per class Accuracy @ 50 epochs Classic TM Baseline20010525*16*2 = 800160,0001160,0000.93 Input Layer TM323316*2 = 321,024 25256,0000.93 Aggregation Layer TM164109*32*2 = 5769,216 Fig. 8. In this setting, agents possess one, three, or four immediate neighbors, implying that Aggregation Layer TMs associated with different agents operate over feature sets of varying cardinalities, thereby inducing heterogeneous model architectures across the network. As reported in Table X, the obtained accuracy of 76% is comparable to that achieved by both the centralized ANN model and the two-dimensional configuration comprising 9 participating agents (see also Fig. 7). 456 0123 78 17.2 cm 8.9 cm Fig. 8: Sensor Network topology graph. Agents with different numbers of nearest neighbors. V. SUMMARY We propose a hierarchical TM-based framework that supports distributed and decentralized learning, cou- pled with consensus-oriented inference procedures. The model assumes that training samples are vertically aligned and that the class labels are available to all agents. The framework is explicitly constructed to safe- guard the privacy of both the model’s internal parameters and each participant’s locally held data. It naturally accommodates heterogeneous TM-based agents that may TABLE X: 9-agent sensor network as in Fig 8. Com- parison between centralized ANN and collaborative TM learning. Model ANN Aggregated data from 9 agents TM Collaborated Learning of 9 agents Class012012 Support200020002000200020002000 Accuracy0.800.76 Precision0.750.750.890.770.670.86 Recall0.750.710.930.630.770.89 F10.750.730.910.690.720.87 Confusion Matrix 14923981101252615133 45314271203041545151 50871863731551772 differ in their sensing modalities, data acquisition pro- cesses, underlying data distributions, or available com- putational power, thus enabling flexible integration and fusion of information in complex settings such as multi- modal sensing scenarios. During inference, the individ- ual predictions produced by each agent’s local model are aggregated to form a shared, system-wide consensus estimate. Throughout this process, communication is restricted to exchanges between an agent and its imme- diate neighbors in the network topology, reinforcing both scalability and privacy. Experiments were conducted using the MNIST, Fashion-MNIST, and Sensor Network datasets, employing two-dimensional grid and connected graph network topologies. The classification accuracies achieved in these experiments are comparable to those of centralized models. Additionally, the models used by the agents are relatively lightweight, highlighting the potential for edge computing. In our experimental study, we assume ideal (i.e., error- free and latency-free) communication channels. A more comprehensive evaluation under realistic communication conditions and deployment environments is left for fu- ture work. VI. DATA AVAILABILITY STATEMENT The data that support the findings of this study are available from the corresponding author, Y. R., upon reasonable request. REFERENCES [1] O.-C. Granmo, “The tsetlin machine - a game theoretic bandit driven approach to optimal pattern recognition with propositional logic,” arXiv preprint arXiv:1804.01508, 2018. [2] O.-C. Granmo and L. Jiao, “Convolutional tsetlin machine: Learning interpretable representations through convolutional clauses,” in International Joint Conference on Neural Networks (IJCNN), 2019. [3] K. D. Abeyrathna, O.-C. Granmo, L. Jiao, and M. Goodwin, “The regression tsetlin machine: A tsetlin machine for continuous output problems,” arXiv preprint arXiv:1905.04206, 2019. [4] L. Jiao, K. D. Abeyrathna, and O.-C. Granmo, “Multi-class tsetlin machine,” arXiv preprint arXiv:2001.08227, 2020. [5] K. D. Abeyrathna, O.-C. Granmo, L. Jiao, and M. Goodwin, “Weighted tsetlin machines: Towards interpretable accurate low- complexity classifiers,” in IEEE Symposium Series on Computa- tional Intelligence (SSCI), 2020. [6] K. D. Abeyrathna, O.-C. Granmo, and M. Goodwin, “Integer weighted tsetlin machines,” arXiv preprint arXiv:2101.10347, 2021. [7] K. D. Abeyrathna, L. Jiao, and O.-C. Granmo, “Coalesced multi- output tsetlin machine,” in International Joint Conference on Neural Networks (IJCNN), 2021. [8] V. Yadav, O.-C. Granmo, and L. Jiao, “Continuous input tsetlin machine,” arXiv preprint arXiv:2101.10346, 2021. [9] K. D. Abeyrathna, O.-C. Granmo, and M. Goodwin, “The recur- rent tsetlin machine,” arXiv preprint arXiv:2104.01409, 2021. [10] V. Yadav, O.-C. Granmo, and L. Jiao, “The fuzzy tsetlin ma- chine,” arXiv preprint arXiv:2201.04977, 2022. [11] A. Yazidi, O.-C. Granmo, and L. Jiao, “Relational tsetlin ma- chines,” in International Workshop on Mining and Learning with Graphs (MLG), 2022. [12] O. Tarasyuk, A. Gorbenko, R. Shafik, and A. Yakovlev, “Multi- layer tsetlin machine: Architecture and performance evaluation,” in International Symposium on Tsetlin Machines (ISTM), 2024. [13] D. A. Kuruge, S. El Mekkaoui, A. Hafver, and C. Agrell, “The probabilistic tsetlin machine: A novel approach to uncertainty quantification,” in Proceedings of the 2024 8thInternationalConferenceonAdvancesinArtificial Intelligence.ACM, Oct. 2024, p. 39–47. [Online]. Available: http://dx.doi.org/10.1145/3704137.3704143 [14] N. Elmisadr, M.-B. Belaid, and A. Yazidi, “Stochastic and deterministic processes in asymmetric tsetlin machine,” Frontiers in Artificial Intelligence, vol. Volume 8 - 2025, 2025. [On- line]. Available: https://w.frontiersin.org/journals/artificial- intelligence/articles/10.3389/frai.2025.1377944 [15] O.-C. Granmo, Y. Abdelwahab, P.-A. Andersen, K. A. K. Borgersen, P. F. A. Clarke, K. Dumbre, Y. Grønningsæter, V. Halenka, R. Helin, L. Jiao, A. Khalid, R. Omslandseter, R. Saha, M. Shende, and X. Zhang, “The tsetlin machine goes deep: Logical learning and reasoning with graphs,” 2026. [Online]. Available: https://arxiv.org/abs/2507.14874 [16] M.L.Tsetlin,AutomationTheoryandModellingof BiologicalSystems,ser.MathematicsinScienceand Engineering.Academic Press, 1974. [Online]. Available: https://books.google.co.il/books?id=3wLEDm bnsC [17] D. A. P. V. I. Varshavsky, Puppets Without Strings. MIR, 1988. [18] M. L. Tsetlin, “Finite automata and models of simple formsofbehaviour,”RussianMathematicalSurveys, vol. 18, no. 4, p. 1, aug 1963. [Online]. Available: https://dx.doi.org/10.1070/RM1963v018n04ABEH001139 [19] S. Garnier, J. Gautrais, and G. Theraulaz, “The biological princi- ples of swarm intelligence,” Swarm Intelligence, vol. 1, p. 3–31, 10 2007. [20] J. Lei, A. Wheeldon, R. A. Shafik, A. Yakovlev, and O.-C. Granmo, “From arithmetic to logic based ai: A comparative analysis of neural networks and tsetlin machine,” 2020 27th IEEE International Conference on Electronics, Circuits and Systems (ICECS), p. 1–4, 2020. [Online]. Available: https://api.semanticscholar.org/CorpusID:230513121 [21] A. Wheeldon, R. A. Shafik, Tousif, Rahman, J. Lei, A. Yakovlev, and O.-C. Granmo, “Learning automata based energy-efficient AI hardware design for IoT applications,” Philosophical transactions. Series A, Mathematical, physical, and engineering sciences, vol. 378, 2020. [Online]. Available: https://api.semanticscholar.org/CorpusID:221244332 [22] A. Bakar, T. Rahman, R. Shafik, F. Kawsar, and A. Montanari, “Adaptive intelligence for batteryless sensors using software- accelerated Tsetlin machines,” in Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems, ser. SenSys ’22.New York, NY, USA: Association for Computing Machinery, 2023, p. 236–249. [Online]. Available: https://doi.org/10.1145/3560905.3568512 [23] A. AbhishekV, S. Binny, R. JohanT, N. Raj, and V. Thomas, “Federated learning: Collaborative machine learning without centralized training data,” international journal of engineering technology and management sciences, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:251659795 [24] H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” 2023. [Online]. Available: https://arxiv.org/abs/1602.05629 [25] A. Akhtarshenas, M. A. Vahedifar, N. Ayoobi, B. Maham, T. Al- izadeh, S. Ebrahimi, and D. L ́ opez-P ́ erez, “Federated learning: A cutting-edge survey of the latest advancements and applications,” 2024. [Online]. Available: https://arxiv.org/abs/2310.05269 [26] Q. Yang, Y. Liu, T. Chen, and Y. Tong, “Federated machine learning: Concept and applications,” 2019. [Online]. Available: https://arxiv.org/abs/1902.04885 [27] J. Li, S. Ding, L. Guo, and X. Li, “Multi-modal anchor gated transformer with knowledge distillation for emotion recognition in conversation,” in Proceedings of the Thirty- ThirdInternational Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization, Aug. 2024, p. 8141–8149. [Online]. Available: http://dx.doi.org/10.24963/ijcai.2024/905 [28] C.-j. Huang, L. Wang, and X. Han, “Vertical federated knowledge transfer via representation distillation for healthcare collaboration networks,” in Proceedings of the ACM Web Conference 2023.ACM, Apr. 2023, p. 4188–4199. [Online]. Available: http://dx.doi.org/10.1145/3543507.3583874 [29] Z. Wu, Z. Qin, J. Hou, H. Zhao, Q. Li, B. He, and L. Fan, “Vertical federated learning in practice: The good, the bad, and the ugly,” 2025. [Online]. Available: https://arxiv.org/abs/2502.08160 [30] Y. Liu, T. Fan, T. Chen, Q. Xu, and Q. Yang, “Fate: An industrial grade platform for collaborative learning with data protection,” Journal of Machine Learning Research, vol. 22, no. 226, p. 1–6, 2021. [Online]. Available: http://jmlr.org/papers/v22/20-815.html [31] P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings, R. G. L. D’Oliveira, H. Eichner, S. E. Rouayheb, D. Evans, J. Gardner, Z. Garrett, A. Gasc ́ on, B. Ghazi, P. B. Gibbons, M. Gruteser, Z. Harchaoui, C. He, L. He, Z. Huo, B. Hutchinson, J. Hsu, M. Jaggi, T. Javidi, G. Joshi, M. Khodak, J. Kone ˇ cn ́ y, A. Korolova, F. Koushanfar, S. Koyejo, T. Lepoint, Y. Liu, P. Mittal, M. Mohri, R. Nock, A. ̈ Ozg ̈ ur, R. Pagh, M. Raykova, H. Qi, D. Ramage, R. Raskar, D. Song, W. Song, S. U. Stich, Z. Sun, A. T. Suresh, F. Tram ` er, P. Vepakomma, J. Wang, L. Xiong, Z. Xu, Q. Yang, F. X. Yu, H. Yu, and S. Zhao, “Advances and open problems in federated learning,” 2021. [Online]. Available: https://arxiv.org/abs/1912.04977 [32] D.LiandJ.Wang,“Fedmd:Heterogenousfederated learning via model distillation,” 2019. [Online]. Available: https://arxiv.org/abs/1910.03581 [33] S. H. S. Qi, J. Chauhan, G. V. Merrett, and J. Hare, “Fedtm: Memory and communication efficient federated learning with tsetlin machine,” 2023 International Symposium on the Tsetlin Machine (ISTM), p. 1–8, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:268254400 [34] —, “FedTMOS: Efficient one-shot federated learning with tsetlin machine,” in The Thirteenth International Conference onLearningRepresentations,2025.[Online].Available: https://openreview.net/forum?id=44hcrfzydU [35] R. J. Gohari, L. Aliahmadipour, and E. Valipour, “Tpfl: Tsetlin- personalized federated learning with confidence-based cluster- ing,” 2024. [Online]. Available: https://arxiv.org/abs/2409.10392 [36] O. Gunvaldsen, H. B. Thorsen, P.-A. Andersen, O.-C. Granmo, and M. Goodwin, “Towards iot anomaly detection with tsetlin machines,” in 2023 International Symposium on the Tsetlin Machine (ISTM), 2023, p. 1–8. [37] J. Lei, T. Rahman, R. Shafik, A. Wheeldon, A. Yakovlev, O.-C. Granmo, F. Kawsar, and A. Mathur, “Low-power au- dio keyword spotting using Tsetlin machines,” arXiv preprint arXiv:2101.11336, 2021. [38] R.Saha,O.-C.Granmo,andM.Goodwin,“Using Tsetlinmachinetodiscoverinterpretablerulesin natural language processing applications,” Expert Systems, vol. 40, no. 4, p. e12873, 2023. [Online]. Available: https://onlinelibrary.wiley.com/doi/abs/10.1111/exsy.12873 [39] B. Bhattarai, O.-C. Granmo, L. Jiao, R. Yadav, and J. Sharma, “Tsetlin machine embedding: Representing words using logical expressions,” arXiv preprint arXiv:2301.00709, 2023. [40] B. Bhattarai, O.-C. Granmo, and L. Jiao, “Measuring the novelty of natural language text using the conjunctive clauses of a Tsetlin machine text classifier,” arXiv preprint arXiv:2011.08755, 2020. [41] R. K. Yadav, L. Jiao, O.-C. Granmo, and M. Goodwin, “Human- level interpretable learning for aspect-based sentiment analysis,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 16, p. 14 203–14 212, May 2021. [Online]. Avail- able: https://ojs.aaai.org/index.php/AAAI/article/view/17671 [42] O.-C. Granmo, S. Glimsdal, L. Jiao, M. Goodwin, C. W. Omlin, and G. T. Berge, “The convolutional tsetlin machine,” 2019. [Online]. Available: https://arxiv.org/abs/1905.09688 [43] O.-C. Granmo, “Tmcomposites: Plug-and-play collaboration between specialized tsetlin machines,” 2023. [Online]. Available: https://arxiv.org/abs/2309.04801 [44] L. Zhao, W.-Z. Song, X. Ye, and Y. Gu, “Asynchronous broadcast-based decentralized learning in sensor networks,” International Journal of Parallel, Emergent and Distributed Systems, vol. 33, no. 6, p. 589–607, 2018. [Online]. Available: https://doi.org/10.1080/17445760.2017.1294690 [45] T. C. Aysal, M. E. Yildiz, A. D. Sarwate, and A. Scaglione, “Broadcast gossip algorithms for consensus,” IEEE Transactions on Signal Processing, vol. 57, no. 7, p. 2748–2761, 2009. [46] N. A. Lynch, Distributed Algorithms. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 1996. [47] D. Peleg, Distributed computing: a locality-sensitive approach. USA: Society for Industrial and Applied Mathematics, 2000. [48] D. Kempe, A. Dobra, and J. Gehrke, “Gossip-based computation of aggregate information,” in 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings., 2003, p. 482–491. [49] Y. LeCun, C. Cortes, and C. Burges, “Mnist handwritten digitdatabase,”ATTLabs[Online].Available: http://yann.lecun.com/exdb/mnist, vol. 2, 2010. [50] O.-C. Granmo, “pytsetlinmachine,” 2019. [Online]. Available: https://github.com/cair/pyTsetlinMachine [51] H. Xiao, K. Rasul, and R. Vollgraf, “Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms,” ArXiv, vol. abs/1708.07747, 2017. [Online]. Available: https://api.semanticscholar.org/CorpusID:702279 [52] T. Rahman, A. Wheeldon, R. Shafik, A. Yakovlev, J. Lei, O.-C. Granmo, and S. Das, “Data booleanization for energy efficient on-chip learning using logic driven ai,” in 2022 International Symposium on the Tsetlin Machine (ISTM), 2022, p. 29–36.