Skip to content
Jae Hoon Kim
Projects
GazeStill PageHaptic descendant filing · haptic-output layer

PageHaptic · drawing set · v1.0

Part I · Cover

U.S. Provisional Patent Application · Drawing set
Appl. No.
Sheets 9
Rev. B · v1.0
Title · Method for modulating force-feedback curves of a haptic input device as a function of a locally-inferred reader-attention index, with discrete force perturbation on detected disengagement
Inventor · J. H. Kim
Internal · PageHaptic · descendant of GazeStill
Filing target · bundled with GazeStill parent
Classification (proposed) · G06F 3/01 · G06F 3/041
About this Descendant filing · v1.0 Child of GazeStill
PageHaptic routes GazeStill's reading-attention index from the visual layer into the haptic layer. The novel hop is binding adaptive force-curves to a locally-inferred physiological attention state — not the existing primitives over which it is built. v1.0 honest acknowledgment (2026-05-18): the haptic-touchpad substrate is squarely anticipated by Immersion Corporation's foundational US 6,429,846 B2 family (Rosenberg / Riegel — same Rosenberg whose Outland Research US 7,429,108 B2 is GazeStill's anticipating reference, a cross-portfolio coincidence) and Apple Force Touch (US 10,162,447 B2, US 20210390823 A1). The surviving claim is the combination: gaze-derived attention index → force-curve modulation bounded by tactile perceptual threshold + discrete "haptic bookmark" perturbation on disengagement.
Abstract of the disclosure Cover-sheet boilerplate v1.0
A system and method modulate the force-response curve of a haptic input device (e.g. a Force Touch trackpad) as a monotonic function of a locally-inferred reader-attention index, where said index is computed from gaze-fixation density over a sliding analysis window of webcam-derived gaze samples per the GazeStill parent disclosure. As the index rises (deeper engagement), the device's actuation force is scaled toward a low-force regime; the magnitude and rate of said scaling are bounded above by a tactile perceptual-threshold floor such that the modulation remains peripheral to user attention. Upon a sustained crossing of a disengagement threshold by the index, a discrete force perturbation — a "haptic bookmark" — is emitted by the device's tactile actuator (rise ≤ 30 ms, plateau ≈ 150 ms at ≤ 1.30× baseline, fall ≤ 30 ms), providing a non-visual cue that reading engagement has lapsed. All inference is performed on the host device; raw gaze frames are discarded after fixation extraction, and no per-user identifier, raw video, or fixation trace is transmitted off-host.
Field
G06F 3/01 · haptic interfaces
Distinguished from
  • Apple Force Touch (US 10,162,447) — actuator + force-curve primitive only
  • MS Surface haptic — actuator only
  • iPad Pencil hover — gesture-coupled, not attention-coupled
  • Tobii gaze-aware UI — visual output, no haptic
  • Kangas haptic gaze 2014 — gaze-gesture trigger, handheld vibrotactile
  • D'Mello Eye-Mind Reader 2020 — visual MW intervention, not haptic
Index of sheets Tap a row to jump 9 sheets
Drawing convention Symbol vocabulary across all figures
Line styles
trackpad force · variable resistance curve
attention index · gaze-derived
disengagement side-channel · bookmark trigger
threshold · θ (disengagement)
host-device boundary · enclosing scope
Numeral convention
  • 100sphysical objects (FIG. 1)
  • 200scurve features & events (FIG. 2, 2A)
  • 300spipeline blocks (FIG. 3)
  • 400scalibration map (FIG. 4)
  • 500sprior-art comparison (FIG. 5)
  • 600sstate-machine nodes (FIG. 6)
  • 700sprivacy boundary & data-flow (FIG. 7)
  • 800ssession-timeline annotations (FIG. 8)
Glyphs
eye · gaze input from webcam (FIG. 1 · 108)
finger · pressing trackpad (FIG. 1 · 104)
trackpad · haptic surface (FIG. 1 · 102)
force ripple · variable resistance F(t) (FIG. 1 · 106)
haptic bookmark · discrete perturbation (FIG. 2 · 206, FIG. 4 · 404)
pipeline block · functional unit (FIG. 3 · 302–308)
data flow · pipeline path (FIG. 3)

Part II · Drawings

Sheet 1 / 9 Representative FIG. 1 · Trackpad finger view · force ripples 100
FIG. 1 · Trackpad finger view with force ripples fixation cluster · paragraph ¶3 116 · keyboard area 102 · haptic trackpad 104 · finger pad 106 · F variable force-into-surface 108 · user (top-down) 110 · gaze ray from GazeStill webcam DETAIL A · 4× side cross-section finger 102 · surface 120 · haptic actuator F force vs. attention 1.3× 0.7× attention low → high 122 · ≈ 130 mm trackpad width
FIG. 1
Sheet 2 / 9 FIG. 2 · Attention vs force curve · bookmark perturbation 200
FIG. 2 · Attention versus trackpad-force with discrete bookmark perturbation 1.0 0.75 0.5 0.25 0.0 attention / force scaling (normalized) ¶1 ¶2 ¶3 ¶4 ¶5 paragraph index · reading progress 212 · θ = 0.40 · disengagement threshold 202 · attention (gaze) 204 · trackpad force baseline 206 · haptic bookmark discrete · ≤ 250 ms · see FIG. 2A crossing 214 · LEGEND 202 · attention curve (gaze) 204 · force baseline 206 · bookmark spike 212 · threshold θ
FIG. 2
Sheet 2A / 9 FIG. 2A · Time-domain perturbation envelope · ≤250 ms · ≤+30% 208
FIG. 2A · Time-domain perturbation envelope time after disengagement trigger (ms) force scaling factor (×) 1.0 · baseline 1.30 · +30% amplitude cap (claim 4) 208 · perturbation envelope 0 100 200 250 300 400 500 ≤ 250 ms total (claim 4) 210 · plateau · ≈ 150 ms JND floor · Allin et al. 2002 (illustrative) Envelope 208 superimposes on the baseline force-scaling factor at the disengagement event; rise < 30 ms, plateau ≈ 150 ms at ≤ 1.30×, fall < 30 ms. Amplitude is bounded above the trackpad-force JND and below the conscious-distraction threshold.
FIG. 2A
Sheet 3 / 9 FIG. 3 · Pipeline · gaze → attention → force-curve 300
FIG. 3 · Pipeline from webcam gaze to trackpad force-curve 300 · HOST DEVICE · baseline mapping (continuous) + disengagement side-channel (discrete) webcam → gaze 302 · GazeStill attention index 304 · sliding window force-curve mapper 306 · LUT (FIG. 4) trackpad driver 308 · haptic actuator fix · 30 fps a(t) ∈ [0,1] k(t) ∈ [0.5,1.5] DISENGAGEMENT SIDE-CHANNEL · 310 · triggered by GazeStill threshold crossing disengagement detector 310 · γ < τ_p sustained perturbation envelope 312 · ≤ 250 ms (FIG. 2A) trigger ∆k(t) γ · density CLOCK DOMAINS · LEGEND webcam · 30 Hz RGB · local inference attention · 1 Hz 30 s sliding window force-curve · 100 Hz trackpad control loop perturbation · 4 kHz haptic envelope synthesis hw + sw software side-channel
FIG. 3
Sheet 4 / 9 FIG. 4 · Force-curve calibration map 400
FIG. 4 · Force-curve calibration map with perturbation envelope at low attention attention index (0 → 1) trackpad force scaling (×) 402 · baseline LUT 404 · perturbation envelope 0 0.5 1.0 Lookup table 402 maps attention index to a force scaling factor; perturbation envelope 404 is added on the disengagement event by a separate side-channel (FIG. 3 · 310). Both are configurable per user.
FIG. 4
Sheet 5 / 9 FIG. 5 · Prior-art comparison matrix · PageHaptic novelty positioning 500
FIG. 5 · Prior-art comparison matrix · PageHaptic occupies the unique intersection haptic output gaze- driven attention coupled on-device inference trackpad form 502 · Apple Force Touch (US 10,162,447) 504 · MS Surface haptic · Dial 506 · Tanvas / TeslaTouch (electrovib.) 508 · Tobii gaze-aware UI 510 · WebGazer (Papoutsaki 2016) 512 · Sharmin gaze auto-scroll 2013 514 · Kangas haptic gaze events 2014 516 · D'Mello Eye-Mind Reader 2020 518 · Southwell webcam MW 2023 520 · PageHaptic (this disclosure) satisfies partial · dedicated hw does not satisfy PageHaptic 520 occupies the unique intersection: haptic output + gaze-driven + attention-coupled (not gesture) + local inference + trackpad form factor. Closest neighbor along the gaze-reading axis: Eye-Mind Reader 516. Closest along the gaze-haptic axis: Kangas 514. Neither covers the trackpad form factor nor the continuous resistance modulator.
FIG. 5
Sheet 6 / 9 FIG. 6 · User-experience state machine 600
FIG. 6 · User-experience state machine READING 602 attn ≥ θ_high force × ≈ 0.6 DRIFTING 604 θ_low ≤ attn < θ_high force × ramping up DISENGAGED 606 attn < θ_low for ≥ T ▶ bookmark fires (608) RESUMING 610 attn ≥ θ_low force × relaxing attn drops θ_low crossed attn recovers (no bookmark) attn ≥ θ_low attn ≥ θ_high · force relaxes back to baseline Four-state model of the reader. The continuous force-displacement modulation (claims 1(c)(d)) operates across all states. The discrete perturbation (claims 1(e), 4, 5) fires exactly on entry to DISENGAGED 606; it does not fire on the DRIFTING → READING recovery transition.
FIG. 6
Sheet 7 / 9 FIG. 7 · Privacy boundary and on-device data-flow 700
FIG. 7 · Privacy boundary and on-device data-flow 700 · HOST DEVICE · on-device boundary 702 · webcam 704 · frame buffer (discarded after extract) 706 · fixation extractor (local) 708 · attention index ∈ [0,1] 710 · force-curve mapper + driver to actuator 712 · raw frames NOT transmitted 714 · CLOUD / REMOTE SERVERS (outside disclosure scope) solid arrow · data within host dashed + accent X · prohibited path dashed border · out-of-scope zone All inference is contained within host-device boundary 700. Frame buffer 704 is discarded immediately after fixation extraction 706; only the dimensionless attention index 708 reaches the force-curve mapper 710. No raw frames, gaze samples, or fixations transit boundary 700 (712).
FIG. 7
Sheet 8 / 9 FIG. 8 · Annotated reading-session timeline (10-minute window) 800
FIG. 8 · Annotated reading-session timeline attention index ∈ [0, 1] 1.0 0.5 0 θ_high · 0.75 θ_low · 0.30 · disengagement 802 ¶2 ¶4 ¶6 ¶8 ¶10 ¶12 force scaling factor (×) 1.5 1.0 0.5 1.0 · baseline 804 · bookmark fires (t ≈ 8 min · ¶11) 0:00 2:00 4:00 6:00 8:00 10:00 time (minutes) A 10-minute reading session. Attention 802 drifts downward as the reader engages, then disengages; force-scaling (lower panel) ramps up in anti-correlation. At t ≈ 8:00 the attention index crosses θ_low; a single discrete perturbation 804 fires — the haptic bookmark. Baseline modulation continues; the perturbation is a superimposed transient.
FIG. 8

Part III · Specification

Field of the invention USPC / IPC classification (proposed) per MPEP § 608.01(d)
The present disclosure relates to the modulation of force-feedback responses in trackpad-class haptic input devices as a function of a locally-inferred reader-attention state derived from on-device webcam gaze inference. More particularly, it relates to a continuous force-displacement curve modulator coupled with a discrete disengagement-triggered perturbation, both driven by an attention-density signal computed from a stream of gaze fixations on a rendered long-form document.
IPC
  • G06F 3/01 · haptic interfaces
  • G06F 3/041 · touch surfaces
  • G06F 3/0354 · pointing devices
Adjacent
  • G06F 3/013 · gaze input
  • G09B 17/00 · reading aids
Background of invention Prior-art context

Apple's Force Touch / haptic-trackpad family (US 10,162,447 B2 and related) covers the underlying actuator hardware and a class of force-curve UX primitives. Microsoft's Surface haptic line, Sensel, Tanvas Touch, and similar surface-haptic products cover analogous hardware spaces. Tobii and other gaze-tracking products drive visual UI changes, occasionally cursor changes, but not haptic curves.

Recent webcam-based mind-wandering work (Bixler & D'Mello 2016; Southwell et al. 2023) establishes that reading-attention state can be inferred on commodity hardware, and Eye-Mind Reader (D'Mello et al. 2020) closes that loop into a visual reading intervention. Gaze-event-triggered haptics on handheld devices (Kangas et al. 2014; Špakov et al. 2014) maps gaze events to brief vibrotactile pulses for auto-scroll gating.

The disclosed system claims a new bridge: a continuous, on-device, attention-density-driven modulation of the force-displacement curve of a Force-Touch-class trackpad, with a discrete disengagement perturbation superimposed only at threshold crossing. The bridge is the novel contribution; the actuator hardware and the upstream gaze inference are prior art.

Stated differently — and this is the load-bearing framing of the disclosure — the input device's own tactile response is repurposed as the calm-tech output surface, under a perceptual-floor bound. Prior reading-attention systems surface engagement feedback on a separate channel: a visual dashboard, a notification, a wearable buzz, or a hand-held fidget. Each of those introduces a new attention-grabbing surface alongside the input device. The disclosed system instead modulates the surface the user is already touching, which makes the feedback peripheral by construction; the user does not have to look elsewhere, switch context, or attend a separate notifier in order to receive it.

Summary of the invention per 37 CFR § 1.73

The disclosed system makes the haptic input device its own calm-tech output surface. A locally-inferred reader-attention index drives a continuous, perceptual-floor-bounded modulation of the device's force-displacement response, and a sustained crossing of a disengagement threshold by said index emits a single discrete force perturbation — the "haptic bookmark" — at the actuator. No separate display, notification, wearable, or accessory is recruited; the surface the user is already touching is the surface that delivers the feedback.

The system consumes the gaze-derived attention index supplied by the GazeStill parent disclosure (block 302 here, corresponding to GazeStill's gaze + density pipeline). A sliding-window attention estimator 304 produces a continuous attention index in [0, 1]. A force-curve mapper 306 applies a configurable look-up table (FIG. 4 · 402) to translate attention to a force-scaling factor, which is forwarded to the trackpad driver 308.

Independently, a disengagement-event side-channel 310 fires a discrete force perturbation when GazeStill's bookmark trigger is asserted, producing the haptic-bookmark sensation depicted at FIG. 2 · 206. The perturbation envelope is bounded above by the conscious-distraction threshold per Pohl 2019 and bounded below by the trackpad-force JND per Allin, Matsuoka & Klatzky 2002.

Brief description of drawings Sheets 1 – 9
Detailed description of the invention Embodiments & alternatives per MPEP § 608.01

The host computing device of FIG. 3 · 300 may comprise, in some embodiments, a laptop computer with an integrated webcam and a Force-Touch-class trackpad. In some embodiments the trackpad comprises a linear-actuator assembly per Apple US 10,162,447 B2; in some embodiments the trackpad comprises an electrovibration surface per Bau et al. 2010 or a programmable-friction surface per Levesque et al. 2011. The disclosed method is independent of the underlying actuator technology and may be practiced on any haptic input device whose force-displacement response is software-modulable.

The webcam-derived gaze pipeline 302 operates entirely on-host. In some embodiments said pipeline comprises a neural-network gaze estimator per Krafka et al. 2016 or Zhang et al. 2015; in some embodiments it comprises a self-calibrating browser-only estimator per Papoutsaki et al. 2016. In all embodiments, raw camera frames are not retained beyond a single fixation-extraction step, and no raw image data leaves the host device.

The sliding-window attention estimator 304 produces a continuous reader-attention index in [0, 1] by integrating fixation density over the rendered document. In some embodiments the integration window is 30 seconds (claim 2); in some embodiments the window is 60 seconds; in some embodiments the window is adaptive to instantaneous reading speed estimated from fixation cadence. The disengagement threshold θ (FIG. 2, FIG. 2A) is configurable per user and, in some embodiments, is calibrated against an initial reading sample of fixed length.

The force-curve mapper 306 applies look-up table 402 (FIG. 4) to translate the attention index into a continuous force-scaling factor, in some embodiments bounded to [0.5, 1.5] of the host device's calibration baseline (claim 3). The mapping is monotonically decreasing in the baseline regime: higher attention yields lighter felt resistance. The mapping is user-configurable and may be replaced, in some embodiments, by a learned function (e.g. a small MLP) fitted to the user's own historical attention-trace.

The disengagement perturbation 310 / 404 / 208 is generated by a side-channel independent of the baseline force-curve path (FIG. 3). In some embodiments said perturbation envelope is rectangular as illustrated in FIG. 2A; in some embodiments it is sinusoidal; in some embodiments it is a raised-cosine or half-sine. The perturbation is distinct from a gaze-gesture-triggered haptic event in that its trigger is an integrated attention-density threshold crossing rather than a momentary saccade or fixation pattern (cf. Kangas et al. 2014, Špakov et al. 2014). The perturbation amplitude is bounded above by the conscious-distraction threshold per Pohl 2019 and below by the trackpad-force just-noticeable-difference per Allin, Matsuoka & Klatzky 2002.

In some embodiments the perceived resistance modulation includes a pseudo-haptic component per Lécuyer 2009, wherein the control–display ratio of scrolling is adjusted in concert with the actuator-force scaling factor, such that the felt lightness of scrolling is reinforced by visual scroll-velocity coupling. In such embodiments the recited force-displacement response of the trackpad encompasses both the physical actuator response and its perceptual counterpart.

Alternative embodiments Claim-scope broadening per MPEP § 608.01(g)

Part IV · Claims

Claims 1 independent · 4 dependent · 1 apparatus Draft v1.0
What is claimed is:

1. A computer-implemented method for continuously modulating the force-displacement response of a trackpad-class haptic input device of a host computing device as a function of a locally-inferred reader-attention state, comprising:

  1. (a)obtaining, from a webcam-derived gaze-fixation pipeline executing locally on said host computing device (302, per GazeStill parent), a stream of gaze fixations on a rendered long-form document;
  2. (b)computing on said host computing device a continuous reader-attention index by sliding-window integration of fixation density over the rendered document (304);
  3. (c)mapping said attention index via a configurable look-up table (306, FIG. 4 · 402) to a continuous force-scaling factor;
  4. (d)continuously applying said force-scaling factor to the force-displacement response of said trackpad (308), said modulation being sustained over time intervals exceeding the duration of any individual gaze fixation;
  5. (e)upon said reader-attention index crossing a configurable disengagement threshold (θ) for a sustained interval, generating a discrete force perturbation superimposed on the force-displacement response (310, 404, FIG. 2A · 208), said perturbation being distinct from any gaze-gesture-triggered haptic event; and
  6. (f)wherein both said continuous modulation of (d) and said discrete perturbation of (e) are, by construction, bounded above in magnitude and rate by a tactile perceptual-threshold floor (per FIG. 2A · 210, FIG. 4 · 402) such that the haptic input device remains peripheral to user attention rather than entering the foreground thereof.

2. The method of claim 1, wherein the attention index is computed per the GazeStill parent disclosure with sliding window of 30 seconds.

3. The method of claim 1, wherein the force-scaling factor lies in [0.5, 1.5] of the host device's calibration baseline.

4. The method of claim 1, wherein the discrete force perturbation has a temporal envelope comprising (i) a rise period not exceeding 30 ms, (ii) a plateau period of approximately 150 ms at amplitude not exceeding 1.30× the baseline force, and (iii) a fall period not exceeding 30 ms; and wherein the total envelope duration does not exceed 250 ms.

5. The method of claim 1, wherein the discrete force perturbation is configured (i) to exceed the just-noticeable difference for trackpad force as established by Allin, Matsuoka & Klatzky 2002, and (ii) to remain below the conscious-distraction threshold for subtle interaction as established by Pohl & Mottelson 2019; and wherein, in some embodiments, the modulation of the force-displacement response includes a pseudo-haptic component per Lécuyer 2009 in which the control–display ratio of scrolling is jointly adjusted with the force-scaling factor.

6. A host computing device comprising a webcam, a trackpad-class haptic input device, one or more processors, and non-transitory memory storing instructions which, when executed by the one or more processors, cause the host computing device to perform the method of any of claims 1 – 5.

Claims · 6 total · 1 independent · 4 dependent · 1 apparatus
Claim · figure support chart Each claim element → supporting figures & reference numerals Patent-prosecution aid
Claim Key element Supporting figures & numerals
1(a) webcam-derived gaze fixations, locally executed FIG. 1 · 108 · FIG. 3 · 302 · FIG. 7 · 702, 706
1(b) continuous attention index by sliding-window integration of fixation density FIG. 2 · 202 · FIG. 3 · 304 · FIG. 7 · 708 · FIG. 8 · 802
1(c) configurable look-up table mapping attention to force-scaling factor FIG. 3 · 306 · FIG. 4 · 402
1(d) continuous force-scaling sustained beyond any single fixation FIG. 2 · 204 · FIG. 3 · 308 · FIG. 4 · 402 · FIG. 8 (lower panel)
1(e) discrete perturbation on disengagement-threshold crossing, distinct from gaze-gesture haptics FIG. 2 · 206 · FIG. 2A · 208, 210 · FIG. 4 · 404 · FIG. 6 · 606, 608 · FIG. 8 · 804
1(f) perceptual-threshold floor — modulation and perturbation remain peripheral, not foreground FIG. 2A · 210 · FIG. 4 · 402
2 30-second sliding window FIG. 3 · 304
3 force-scaling factor in [0.5, 1.5] FIG. 4 · 402 · FIG. 8 (Y-axis range)
4 perturbation envelope — rise ≤ 30 ms, plateau ≈ 150 ms at ≤ 1.30×, fall ≤ 30 ms, total ≤ 250 ms FIG. 2A · 208, 210
5 perceptual bounds (JND floor / conscious-distraction ceiling) + pseudo-haptic broadening FIG. 2A (JND floor annotation)
6 host computing device · apparatus FIG. 3 · 300 · FIG. 7 · 700

Part V · Appendices

Reference numerals Index of callouts across FIG. 1 – 8 per MPEP § 608.02
100s · physical objects (FIG. 1)
  • 102haptic trackpad
  • 104finger
  • 106variable force F(t)
  • 108gaze input from GazeStill
200s · curve features & events (FIG. 2 / 2A)
  • 202attention curve · gaze-derived
  • 204trackpad force curve
  • 206haptic bookmark · perturbation event
  • 208perturbation envelope (time-domain)
  • 210plateau region of envelope
600s · state-machine nodes (FIG. 6)
  • 602READING (engaged)
  • 604DRIFTING
  • 606DISENGAGED · bookmark-firing state
  • 608bookmark fires on entry to 606
  • 610RESUMING
300s · pipeline blocks (FIG. 3)
  • 300host device boundary
  • 302webcam → gaze (GazeStill)
  • 304sliding-window attention estimator
  • 306force-curve mapper · LUT
  • 308trackpad driver
  • 310disengagement side-channel · detector
  • 312perturbation envelope · generator
400s · calibration map (FIG. 4)
  • 402baseline look-up table
  • 404perturbation envelope (on attention axis)
500s · prior-art comparison (FIG. 5)
  • 502Apple Force Touch
  • 504MS Surface haptic · Dial
  • 506Tanvas · TeslaTouch
  • 508Tobii gaze-aware UI
  • 510WebGazer (Papoutsaki 2016)
  • 512Sharmin gaze auto-scroll 2013
  • 514Kangas haptic gaze 2014
  • 516D'Mello Eye-Mind Reader 2020
  • 518Southwell webcam MW 2023
  • 520PageHaptic (this disclosure)
700s · privacy boundary (FIG. 7)
  • 700host-device boundary
  • 702webcam
  • 704frame buffer · discarded
  • 706fixation extractor
  • 708attention index
  • 710force-curve mapper + driver
  • 712prohibited path · NO transmit
  • 714cloud · out-of-scope
800s · session-timeline (FIG. 8)
  • 802attention-index trace
  • 804bookmark-firing event (timestamped)
Prior-art bibliography Selected; not exhaustive

Part VI · Execution

Version history Draft · not filed

This descendant cites the GazeStill parent specification (see /gazestill) for the attention-inference primitive and adds one narrow claim group (force-curve modulation + disengagement perturbation).

/pagehaptic · v1.0 · drawing-stage · child of /gazestill
Index