One input. One activation.
A conventional neuron compresses its input into a single scalar activation. It is precise, stable and efficient, but it collapses local possibilities immediately into one point.
h = φ(wᵀx + b)
Variational intelligence, built from the neuron up
We’re building the next generation of models: Variational Distributional LLMs.
JWAYU 杰维宇 develops language models in which uncertainty is not added only at the output. It becomes part of the internal computation itself, through EVE — the Elemental Variational Expanse.
Local distributionsinside hidden computation
Measurable uncertaintyKL, variance, mutual information
Transformer-readyintegrated into language modeling
Our thesis
The network is not the starting point. The neuron is.
Modern language models are extraordinarily capable, yet their internal units remain largely deterministic. JWAYU begins with a different premise: when ambiguity is intrinsic to intelligence, the computational unit should be able to represent it.
One input. A structured space of possibilities.
An EVE unit constructs an input-conditioned posterior, samples a latent state through reparameterization and uses that state directly in computation.
qφ(z|x) = 𝒩(μ(x), diag(σ²(x)))
EVE — Elemental Variational Expanse
What is a variational distributional neuron?
It is a local probabilistic computational unit with an explicit prior, an amortized posterior and unit-level variational regularization. The activation is no longer merely a value: it is generated from a learned distribution.
Condition
The unit receives the current representation and produces posterior parameters.
Represent
A local Gaussian posterior carries a continuous set of plausible latent states.
Sample
Reparameterization produces a differentiable latent sample used in the forward pass.
Constrain
A local KL term regulates the posterior relative to its prior and makes the regime measurable.
Point computation
Propagates one activation. Uncertainty is not represented inside the unit.
Randomized computation
Introduces randomness through masks or sampled paths, without turning each unit into an explicit input-conditioned latent posterior.
Distributional computation
Maintains a learned local distribution with a prior, posterior, latent sample and internal diagnostics.
A language model should not have to collapse uncertainty before it has used it.
A variational distributional language model introduces EVE units into the model’s hidden computation, including Transformer feed-forward blocks. The overall architecture remains recognizable, while its internal computational primitive changes.
Instead of treating uncertainty as a final confidence score, the model can carry local latent structure across layers and use internal signals such as posterior variance, KL divergence and mutual information for evaluation, calibration and control.
From neuron to model
A research program across four layers.
JWAYU develops the primitive, studies its operating regime, integrates it into Transformers and turns internal uncertainty into an actionable signal.
The neuron is the distribution
Define local variational computation and make its internal probabilistic state observable.
Build networks from EVE units
Study stability, capacity, latent dimensionality, temporal persistence and collapse control.
Variational Transformers
Integrate EVE into feed-forward computation while preserving a practical Transformer backbone.
Research
Publications building the field step by step.
The research begins with the computational unit, maps its design space, moves into language modeling and explores uncertainty as an interface for agentic control.
Variational Distributional Neuron
Introduces the proof of concept: a compute unit formulated as a local VAE primitive with a prior, amortized posterior and local ELBO.
Exploring the Dimensions of a Variational Neuron
Studies latent dimensionality, local capacity, temporal persistence and the measurable internal operating regime of EVE.
Variational Neurons in Transformers for Language Modeling
Places EVE units inside Transformer feed-forward computation and evaluates predictive quality, calibration and uncertainty signals.
Agentic Control in Variational Language Models
Explores internal uncertainty as an operational signal for regulation, checkpoint retention and inference-time intervention.
For investors and strategic partners
A new computational primitive for uncertainty-aware AI.
JWAYU 杰维宇 is building intellectual property, experimental evidence and implementation expertise around variational distributional neurons and language models.
Change the unit, open a new model space.
Distinct technical thesis
Move probabilistic structure from only global mechanisms or outputs into hidden computational units.
Measurable internal state
Expose local signals that can support calibration, robustness analysis, routing and model control.
Architecture-compatible path
Develop the primitive inside familiar neural and Transformer backbones rather than replacing the entire ecosystem.
Published research trajectory
A growing sequence of public preprints establishes the concept, design space, language-model integration and agentic use.
Research · Engineering · Collaboration
Build the next generation of language models with us.
We welcome conversations with researchers, frontier-model teams, engineers, doctoral partners and organizations interested in uncertainty-aware multimodal and language models.