We present a class of $U(1)_X$ models which are can simultaneously explain the neutrino mixings and flavor anomalies in neutral B decays. The frugal set up apart from additional $Z^\prime$, requires additional singlet scalar for neutrino mixings and an additional scalar doublet for quark mixings. Our set up identifies a class of symmetries wherein all generations of quarks are necessarily charged, rendering collider constraints to be stringent. We show all our models with the assumption of CKM-like mixings are ruled out from the current data. Introduction of a single source parameter for non-minimal mixings allows for a wider class of models consistent with the data. We show the viable symmetry patterns are of the form $L_e - 3 L_\mu - L_\tau$, $L_e - 3 L_\mu + L_\tau$, and $L_e + 3 L_\mu - L_\tau$.
