FairBED: Incorporating Fairness into Bayesian Experimental Design

arXiv:2606.23515v2 Announce Type: replace-cross Abstract: Bayesian experimental design (BED) has traditionally focused exclusively on collecting data that is maximally informative, with little consideration of other desirable dataset characteristics, such as fairness. We therefore extend BED to target data that is both informative and fair. To this end, we introduce FairBED, which provides a formalism for the fairness of datasets themselves by measuring how compatible they are with a fair world, in which the target quantity we wish to learn about is unrelated to the sensitive attributes we want to be fair to. We then use this to construct practical fairness-aware BED objectives that maximise expected information gain about the target variables, while penalising information about sensitive attributes and/or their coupling with the target. We further extend FairBED to active learning, and show empirically that models trained on data gathered using FairBED provide improved fairness-accuracy trade-offs compared to randomly acquired data and conventional BED.