Paper deep dive
Fairness-Aware Mixture-of-Experts via Subgroup Reweighting and Gate Regularization
Sunhee Hwang
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Deep learning models often produce performance disparities across demographic groups, due to the training data imbalance with respect to sensitive attributes such as gender or age. To address this problem, existing work has explored fair representation learning, data re-sampling, and adversarial training, which can be broadly categorized into two main approaches. Single-stage methods typically learn a shared representation for fairness, but often struggle to handle heterogeneous subgroup distributions. Two-stage methods learn representations separately from the final prediction task, which can lead to misalignment between fairness objectives and downstream predictions. We identify routing-induced bias, a failure mode in which subgroup imbalance drives the gating network to route subgroups onto a few experts, and propose an end-to-end Mixture-of-Experts (MoE) framework that corrects it. Specifically, we apply subgroup reweighting to correct data imbalance, and introduce gate entropy regularization to prevent routing from collapsing onto subgroup attributes, keeping expert utilization both balanced and interpretable. Beyond improving fairness, the routing distribution offers an interpretable view of how subgroups are allocated across experts. Experimental results demonstrate that the proposed approach improves fairness while maintaining competitive predictive performance.
Tags
Links
- Source: https://arxiv.org/abs/2608.22820v1
- Canonical: https://arxiv.org/abs/2608.22820v1
Trouble viewing inline? Open PDF directly â
Full Text
27,252 characters extracted from source content.
Expand or collapse full text
Fairness-Aware Mixture-of-Experts via Subgroup Reweighting and Gate Regularization Sunhee Hwang Affiliation: Dongyang Mirae University Seoul, Republic of Korea sunheehwang@dongyang.ac.kr Abstract Deep learning models often produce performance disparities across demographic groups, due to the training data imbalance with respect to sensitive attributes such as gender or age. To address this problem, existing work has explored fair representation learning, data re-sampling, and adversarial training, which can be broadly categorized into two main approaches. Single-stage methods typically learn a shared representation for fairness, but often struggle to handle heterogeneous subgroup distributions. Two-stage methods learn representations separately from the final prediction task, which can lead to misalignment between fairness objectives and downstream predictions. We identify routing-induced bias, a failure mode in which subgroup imbalance drives the gating network to route subgroups onto a few experts, and propose an end-to-end Mixture-of-Experts (MoE) framework that corrects it. Specifically, we apply subgroup reweighting to correct data imbalance, and introduce gate entropy regularization to prevent routing from collapsing onto subgroup attributes, keeping expert utilization both balanced and interpretable. Beyond improving fairness, the routing distribution offers an interpretable view of how subgroups are allocated across experts. Experimental results demonstrate that the proposed approach improves fairness while maintaining competitive predictive performance. Index Terms: fairness, mixture-of-experts, equalized odds, routing-induced bias, bias mitigation I Introduction Deep neural networks have achieved remarkable success across a wide range of visual recognition tasks. In high-stakes applications such as face analysis, however, their predictions are increasingly required to be not only accurate but also fair across demographic groups defined by sensitive attributes such as gender or age [12, 21, 17]. In practice, this requirement is often violated: models tend to perform substantially better on some groups than others. A key reason is that when a target label is statistically correlated with a sensitive attribute in the training data, the model can minimize its loss by exploiting this shortcut rather than learning the true decision rule. As a result, the learned representation entangles the target with the sensitive attribute, and the resulting accuracy gap across groups manifests as unfairness at inference time. A main challenge is that such bias originates not from the model architecture alone, but from the structure of the training data itself. Real-world datasets are rarely balanced: certain combinations of target label and sensitive attributeâfor example, a positive label paired with an underrepresented groupâappear far less frequently than others. During training, the model is exposed to the majority subgroups far more frequently and optimizes predominantly for them, while underrepresented subgroups receive little gradient signal and are effectively underfit. This imbalance therefore produces disparities not at the level of individual attributes, but across their intersections (y,s)(y,s), where the scarcest subgroups suffer the largest performance drops [18, 10]. Existing approaches mitigate bias through representation learning, disentanglement, or data-level interventions [15, 16, 22, 5, 11, 6]. However, many rely on decoupled or multi-stage pipelines, in which fair representation learning is performed separately from the downstream prediction task. Such formulations do not fully optimize fairness in an end-to-end manner. This can lead to suboptimal alignment between representation learning and the final prediction objective. Several methods adopt single-stage training that jointly optimizes task performance and fairness [9, 8, 14]. However, these approaches typically rely on a shared representation space. This makes it difficult to capture heterogeneous subgroup characteristics while maintaining both fairness and accuracy. As a result, a trade-off between bias mitigation and predictive performance is often observed. These limitations point to a deeper need: a model that can process heterogeneous subgroups through separate computational pathways rather than a single shared representation. Mixture-of-Experts (MoE) provides exactly this capability through its expert routing mechanism. However, we find that MoE introduces a new and previously underexplored failure mode: under subgroup imbalance, the gating networkâoptimized predominantly on majority subgroupsâcorrelates its routing decisions with sensitive attributes, concentrating each subgroup onto a few experts and leaving others underutilized. We term this routing-induced bias. Crucially, this failure is specific to conditional routing and is therefore invisible to existing fairness methods built on a single shared representation. To address it, we propose FAMoE, a fairness-aware MoE framework that diagnoses and corrects routing-induced bias end-to-end. The source code is available at https://github.com/sunhee-hwang/FAMoE. Our main contributions are summarized as follows: âą We identify routing-induced bias as a previously underexplored failure mode in Mixture-of-Experts models, in which subgroup imbalance drives the gating network to correlate routing decisions with sensitive attributes, yielding skewed expert utilization. âą We propose FAMoE, which corrects routing-induced bias end-to-end by combining subgroup reweighting with a gate entropy regularization that, unlike its conventional use for load balancing, here keeps routing interpretable by preventing experts from being monopolized by specific subgroups. âą We show that the routing distribution serves as an interpretable diagnostic of subgroup-level behavior, revealing how fairness is achieved an inspectability absent in monolithic representation-based methods. âą We demonstrate consistent improvements in the fairness -accuracy trade-off across multiple target and sensitive attribute settings on CelebA, alongside more balanced expert utilization. Fig. 1: Overview of the proposed FAMoE (Fairness-Aware Mixture-of-Experts) framework. I Related Work I-A MoE and Routing Dynamics MoE is a conditional computation framework in which a gating network dynamically assigns inputs to a subset of experts, enabling input-dependent processing and improved model capacity [7]. This routing mechanism enables experts to specialize in different regions of the input space. It also facilitates modeling of heterogeneous data. Prior work on MoE has primarily focused on improving efficiency and scalability. Sparse models, exemplified by the Switch Transformer, mitigate computational overhead by selectively activating a subset of experts for each incoming token [1]. However, imbalanced expert utilization remains a well-known challenge in routing design [20]. Furthermore, empirical evidence consistently demonstrates expert specialization, wherein individual experts encode distinct functional or semantic patterns [13]. Despite these advances, existing MoE research has largely emphasized routing as an optimization and efficiency problem. While prior work has considered data heterogeneity and fairness in isolation, how subgroup imbalance shapes routing decisions remains largely unexamined. Recent work has begun to explore fairness in MoE models. For example, FairMOE introduces fairness-aware mechanisms into the expert selection process using counterfactual fairness criteria to promote consistency across protected attributes [2]. However, it does not analyze the interaction between data imbalance and routing dynamics. It also does not control this interaction during training. I-B Learning Fairness Representation Bias mitigation in visual classification mainly relies on representation learning. Existing methods adopt either end-to-end joint optimization or multi-stage frameworks to enforce fairness constraints. Under joint optimization settings, adversarial techniques utilize gradient reversal [19] to penalize the encoding of sensitive attributes. Mutual information-based objectives [9] operate on a similar principle by minimizing the statistical dependence between learned features and protected variables. Other strategies address fairness by directly intervening in the feature space. MFD [8] and Fair-VPT [14] suppress sensitive cues within a shared representation to prevent the classifier from utilizing demographic information. To formally model the structural interactions between target and sensitive attributes, disentanglement techniques decouple the representations. FD-VAE [15] partitions the feature space into target-specific, sensitive, and shared components to capture the overlap between features. Recent literature extends these representation learning principles to account for inherent data imbalances and spurious correlations. These strategies encompass submodular hard sample mining (SHaSAM [11]), balanced training pair construction via data augmentation (FairCL [22]), and group-aware correlation suppression (Fair-GDMS [5]). Although effective at reducing bias, these methodologies operate exclusively on a globally shared representation space. Processing highly heterogeneous data distributions across varying subgroups within a monolithic feature space restricts the modelâs representational flexibility. This shared-space bottleneck indicates the necessity of input-dependent computation pathways to accommodate subgroup-specific characteristics. While conditional architectures like Mixture-of-Experts (MoE) provide this structural flexibility, they remain largely underexplored in the context of fairness. Furthermore, as our analysis reveals, standard conditional routing mechanisms are inherently susceptible to subgroup imbalance, necessitating a new framework that jointly addresses data heterogeneity and expert utilization. I Fairness-Aware Mixture-of-Experts Framework I-A Overall Framework We propose a fairness-aware visual classification framework based on a MoE architecture, as illustrated in Fig. 1. Given an input image x, a shared backbone encoder first extracts a feature representation zââdz ^d. This representation is then used as input to both the expert networks and the gating network. The backbone encoder is shared across all model variants to ensure that differences in performance and fairness can be attributed to the MoE components rather than feature extraction. This design enables a controlled comparison of modeling choices within a unified feature space. The MoE head consists of N experts Eii=1N\E_i\_i=1^N and a gating network GâĄ(â )G(·). Each expert independently processes the shared feature z and produces an expert-specific output, while the gating network computes a routing weight for each expert based on the same input. The final prediction is obtained by aggregating the expert outputs using the routing weights produced by the gating network. This structure allows the model to adaptively combine multiple expert predictions in a data-dependent manner, enabling flexible modeling of diverse input patterns within a single framework. I-B Expert Prediction and Gated Aggregation Given the shared feature representation z, each expert EiE_i produces an intermediate representation, which is passed through a classifier CiC_i to obtain an expert-specific logit: oi=Ciâ(Eiâ(z)).o_i=C_i(E_i(z)). (1) The gating network GâĄ(â )G(·) computes a routing vector g=[g1,âŠ,gN]g=[g_1,âŠ,g_N], where each element represents the importance of the corresponding expert. The routing weights are normalized using a softmax function: gi=expâĄ(ai)âj=1NexpâĄ(aj),g_i= (a_i) _j=1^N (a_j), (2) where aia_i denotes the routing score for expert i. The final prediction is obtained by aggregating the expert outputs using the routing weights: o^=âi=1Ngiâoi. o= _i=1^Ng_io_i. (3) For binary classification, the final prediction probability is computed as y^=ÏâĄ(o^) y=Ï( o), where ÏâĄ(â )Ï(·) denotes the sigmoid function. I-C Subgroup Reweighting for Joint Attribute Imbalance To address imbalance across target and sensitive attributes, we incorporate subgroup reweighting into the training process. Each sample is associated with a joint subgroup defined by its target label y and sensitive attribute s. Let ny,sn_y,s denote the number of samples in subgroup (y,s)(y,s). We assign each subgroup (y,s)(y,s) a weight inversely proportional to its size: wy,sâ1ny,s.w_y,s 1n_y,s. (4) This weighting scheme increases the contribution of underrepresented subgroups during training. We employ a weighted binary cross-entropy loss: âcls=âi=1Bwyi,siâ BCEâ(o^i,yi),L_cls= _i=1^Bw_y_i,s_i·BCE( o_i,y_i), (5) where B denotes the batch size. TABLE I: Comparison of fairnessâaccuracy trade-offs on CelebA across multiple target attributes. We report Equalized Odds (EO), accuracy, and the FairnessâAccuracy Trade-off Score (FATS), under sensitive attributes (Male and Young). A lower FATS indicates a more favorable trade-off. * denotes the method re-implemented by the authors. Male and Young denote the sensitive attribute s used to compute EO; all samples (both s=0s=0 and s=1s=1) are included in training and evaluation. Bold indicates the best result within each stage category (1-stage and 2-stage), reported separately for each column. Method Year Stage Target: Attractiveness Target: Big Nose Male Young Male Young EO ACC FATS EO ACC FATS EO ACC FATS EO ACC FATS ResNet-18 [4] 2016 Baseline 27.8 79.6 27.9 16.8 79.8 16.9 17.6 84.0 17.7 14.7 84.5 14.8 *ResNet-18 [4] + MoE [7] 2016 / 1991 13.3 81.0 13.4 22.4 81.1 22.5 16.0 84.1 16.1 14.1 84.3 14.2 FD-VAE [15] 2021 2-stage 15.1 76.9 15.2 14.8 77.5 14.9 11.2 81.6 11.3 6.7 81.7 6.8 FSCL [16] 2022 6.5 79.1 6.6 12.4 79.1 12.5 4.7 82.9 4.8 4.8 84.1 4.9 FairCL [22] 2023 16.8 75.3 16.9 13.1 76.9 13.2 8.4 80.1 8.5 9.2 80.3 9.3 Fair-GDMS [5] 2026 7.0 83.2 7.1 - - - 13.2 84.8 13.3 - - - SHaSAM [11] 2026 5.5 81.3 5.6 9.9 79.6 10.0 3.3 84.7 3.4 3.9 87.0 4.0 GRL [19] 2018 1-stage 24.9 77.2 25.0 14.7 74.6 14.8 14.0 82.5 14.1 10.0 83.3 10.1 LNL [9] 2019 21.8 79.9 21.9 13.7 74.3 13.8 10.7 82.3 10.8 6.8 82.3 6.9 MFD [8] 2021 7.4 78.0 7.5 14.9 80.0 15.0 7.3 78.0 7.4 5.4 78.0 5.5 Fair-VPT [14] 2024 12.0 78.6 12.1 - - - 15.9 79.9 16.0 - - - FAMoE (Ours) 2026 4.1 80.0 4.2 8.3 79.8 8.4 4.5 80.1 4.6 3.3 80.8 3.4 I-D Gate Entropy Regularization To promote balanced utilization of experts, we introduce a gate entropy regularization term. Given the routing distribution g for each input, the entropy is defined as: H(g)=ââi=1Ngiloggi.H(g)=- _i=1^Ng_i g_i. (6) We add this term to encourage higher entropy in the routing distribution. The overall loss function is defined as: â=âclsâλentâHâ(g),L=L_cls- _entH(g), (7) where λent _ent controls the strength of the regularization. This regularization reduces overly concentrated routing decisions. It also encourages the utilization of multiple experts during training. As a result, the model maintains diverse expert contributions while performing data-dependent aggregation. Importantly, this regularization is not merely a fairness penalty but a mechanism that keeps the routing distribution interpretable: by preventing an expert from being monopolized by a specific subgroup, the resulting gate weights remain a faithful diagnostic of how the model distributes subgroups across experts. I-E Training Objective The overall training objective combines subgroup reweighting and gate entropy regularization. Different model variants are instantiated by selectively enabling each component. Specifically, the standard MoE model is obtained by setting wy,s=1w_y,s=1 and λent=0 _ent=0, while the reweighted model incorporates subgroup weights with λent=0 _ent=0. The full model includes both subgroup reweighting and entropy regularization. All models are trained end-to-end using stochastic gradient descent, where the encoder, experts, and gating network are jointly optimized. IV Experiments IV-A Experimental Setup We evaluate the proposed method on the CelebA dataset, which contains facial images annotated with multiple binary attributes. Following standard practice, we consider binary classification tasks with a designated target attribute and a sensitive attribute. Each sample is associated with a pair (y,s)(y,s), where y denotes the target label and s denotes the sensitive attribute. The dataset is split into training, validation, and test sets according to the official partition. Images are resized to 128Ă128128Ă 128 and normalized. We use standard data augmentation, including random resized cropping and horizontal flipping during training. All models share the same backbone encoder based on ResNet-18. The MoE head consists of four experts and a gating network that produces a routing distribution over experts. Each expert is a two-layer MLP (512â128â64512â 128â 64) with ReLU activation, followed by an expert-specific linear classifier (64â164â 1). All experts share the same architecture but maintain independent parameters. The gating network is a single linear layer (512â4512â 4) followed by a softmax. Models are trained using the Adam optimizer with a learning rate of 10â410^-4 and weight decay of 10â410^-4 for 30 epochs. We evaluate performance using classification accuracy, Equalized Odds (EO) [3], and the FairnessâAccuracy Trade-off Score (FATS). EO measures the difference in prediction performance across subgroups defined by (y,s)(y,s). Following [16], we compute EO as the average accuracy gap across sensitive groups within each target class. FATS is defined as: FATS=EO+αâĄ(1âAcc),FATS=EO+α(1-Acc), (8) where α controls the trade-off between fairness and accuracy. In our experiments, we set α=0.5α=0.5 to weight fairness and accuracy degradation equally, and a lower FATS indicates a more favorable balance between fairness and predictive performance. The best model is selected based on the validation FATS. IV-B Main Results Table I presents the comparison with existing fairness-aware methods across different target and sensitive attribute settings. Compared to one-stage methods such as GRL, LNL, and MFD, the proposed method consistently improves fairness while avoiding large drops in accuracy. Compared to two-stage approaches, including FD-VAE, FairCL, and Fair-GDMS, the proposed method achieves a more favorable balance between fairness and accuracy, as reflected in consistently lower FATS values. These results indicate that jointly addressing subgroup imbalance and routing decisions leads to improved fairness compared to existing approaches. TABLE I: Ablation study of proposed components on CelebA (Target: Attractiveness). Components Sensitive: Male Subgroup Reweighting Gate Entropy Regularization EO ACC FATS â â 13.3 81.0 13.4 â â 4.2 79.6 4.3 â â 4.1 80.0 4.2 IV-C Ablation Study Table I shows the effect of each component in the proposed framework. The standard MoE model achieves an EO of 13.3, indicating that MoE alone does not improve fairness. Adding subgroup reweighting reduces EO from 13.3 to 4.2, confirming that data imbalance is a primary driver of routing bias. Reweighting alone, however, leaves routing concentration uncontrolled; adding gate entropy regularization further improves EO to 4.1, recovers accuracy, and yields the balanced, interpretable routing analyzed in Fig. 2. Entropy regularization thus complements reweighting by promoting balanced expert utilization. Fig. 2: Average gate weights across subgroups for the standard MoE and the proposed method. IV-D Analysis of Expert Utilization To investigate expert utilization patterns, we analyze the average gate weights across demographic subgroups (Fig. 2). In the standard MoE baseline, routing decisions exhibit pronounced skewness. Specific experts are disproportionately activated by certain subgroups, while others remain underutilized. This observation indicates that the baseline routing mechanism inadvertently captures spurious correlations with sensitive attributes. In contrast, our method effectively mitigates this dependency, yielding a more balanced distribution of routing weights. These empirical findings demonstrate that our approach prevents a single subgroup from dominating expert capacity, thereby promoting more equitable expert utilization across subgroups. This analysis is only possible because routing exposes expert allocation explicitly. Monolithic models that share a single representation space may reach comparable fairness scores, yet they offer no comparable window into how fairness is achieved. The gate-weight distribution in Fig. 2 thus serves as a built-in diagnostic of subgroup-level model behavior, a form of routing-level interpretability not available in monolithic representation-based methods. V Conclusion This study addresses the degradation of fairness in MoE models caused by imbalanced data distributions. We show that, under subgroup imbalance, conditional routing tends to induce systematic bias, skewing expert utilization based on subgroup attributes. Recognizing that existing representation-focused methods fail to capture this routing-induced bias, we propose a framework combining subgroup reweighting with gate entropy regularization. Our empirical results demonstrate that regularizing routing behaviors while correcting data imbalance promotes more balanced expert assignment and substantially improves the fairnessâaccuracy trade-off. Overall, this work highlights the critical necessity of explicitly accounting for expert utilization, which not only improves fairness but also renders the modelâs subgroup-level behavior interpretable through its routing distributionâa form of transparency not offered by monolithic fairness methods. VI Acknowledgment This work was supported by the Korea Foundation for Women in Science, Engineering and Technology (WISET) with funding from the Science and Technology Promotion Fund and Lottery Fund (WISET 2026-236). References [1] W. Fedus, B. Zoph, and N. Shazeer (2022) Switch transformers: scaling to trillion parameter models with simple and efficient sparsity. Journal of Machine Learning Research 23 (120), p. 1â39. Cited by: §I-A. [2] J. Germino, N. Moniz, and N. V. Chawla (2024) FairMOE: counterfactually-fair mixture of experts with levels of interpretability. Machine Learning 113 (9), p. 6539â6559. Cited by: §I-A. [3] M. Hardt, E. Price, and N. Srebro (2016) Equality of opportunity in supervised learning. Advances in neural information processing systems 29. Cited by: §IV-A. [4] K. He, X. Zhang, S. Ren, and J. Sun (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, p. 770â778. Cited by: TABLE I, TABLE I. [5] H. Huang, K. Li, S. Chen, and D. Wang (2026) Fair facial attribute recognition via group-decoupled vision transformer with mask-guided correlation suppression. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 40, p. 5022â5030. Cited by: §I, §I-B, TABLE I. [6] S. Hwang, S. Park, P. Lee, S. Jeon, D. Kim, and H. Byun (2020) Exploiting transferable knowledge for fairness-aware image classification. In Proceedings of the Asian Conference on Computer Vision, Cited by: §I. [7] R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton (1991) Adaptive mixtures of local experts. Neural computation 3 (1), p. 79â87. Cited by: §I-A, TABLE I. [8] S. Jung, D. Lee, T. Park, and T. Moon (2021) Fair feature distillation for visual recognition. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, p. 12115â12124. Cited by: §I, §I-B, TABLE I. [9] B. Kim, H. Kim, K. Kim, S. Kim, and J. Kim (2019) Learning not to learn: training deep neural networks with biased data. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, p. 9012â9020. Cited by: §I, §I-B, TABLE I. [10] D. Kim, S. Park, S. Hwang, and H. Byun (2023) Fair classification by loss balancing via fairness-aware batch sampling. Neurocomputing 518, p. 231â241. Cited by: §I. [11] A. Majee and R. Iyer (2026) SHaSaM: submodular hard sample mining for fair facial attribute recognition. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, p. 7461â7471. Cited by: §I, §I-B, TABLE I. [12] N. Mehrabi, F. Morstatter, N. Saxena, K. Lerman, and A. Galstyan (2021) A survey on bias and fairness in machine learning. ACM computing surveys (CSUR) 54 (6), p. 1â35. Cited by: §I. [13] J. Oldfield, M. Georgopoulos, G. G. Chrysos, C. Tzelepis, Y. Panagakis, M. A. Nicolaou, J. Deng, and I. Patras (2024) Multilinear mixture of experts: scalable expert specialization through factorization. Advances in Neural Information Processing Systems 37, p. 53022â53063. Cited by: §I-A. [14] S. Park and H. Byun (2024) Fair-vpt: fair visual prompt tuning for image classification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 12268â12278. Cited by: §I, §I-B, TABLE I. [15] S. Park, S. Hwang, D. Kim, and H. Byun (2021) Learning disentangled representation for fair facial attribute classification via fairness-aware information alignment. In Proceedings of the AAAI conference on artificial intelligence, Vol. 35, p. 2403â2411. Cited by: §I, §I-B, TABLE I. [16] S. Park, J. Lee, P. Lee, S. Hwang, D. Kim, and H. Byun (2022) Fair contrastive learning for facial attribute classification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 10389â10398. Cited by: §I, TABLE I, §IV-A. [17] D. Pessach and E. Shmueli (2022) A review on fairness in machine learning. ACM computing surveys (CSUR) 55 (3), p. 1â44. Cited by: §I. [18] D. Plecko and E. Bareinboim (2025) Fairness-accuracy trade-offs: a causal perspective. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 39, p. 26344â26353. Cited by: §I. [19] E. Raff and J. Sylvester (2018) Gradient reversal against discrimination: a fair neural network learning approach. In 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA), p. 189â198. Cited by: §I-B, TABLE I. [20] L. Wang, H. Gao, C. Zhao, X. Sun, and D. Dai (2024) Auxiliary-loss-free load balancing strategy for mixture-of-experts. arXiv preprint arXiv:2408.15664. Cited by: §I-A. [21] Y. Wang, W. Ma, M. Zhang, Y. Liu, and S. Ma (2023) A survey on the fairness of recommender systems. ACM Transactions on Information Systems 41 (3), p. 1â43. Cited by: §I. [22] F. Zhang, K. Kuang, L. Chen, Y. Liu, C. Wu, and J. Xiao (2022) Fairness-aware contrastive learning with partially annotated sensitive attributes. In The Eleventh International Conference on Learning Representations, Cited by: §I, §I-B, TABLE I.