PageHaptic · drawing set · v1.0
Part I · Cover Docket · Abstract · v1.0
- Apple Force Touch (US 10,162,447) — actuator + force-curve primitive only
- MS Surface haptic — actuator only
- iPad Pencil hover — gesture-coupled, not attention-coupled
- Tobii gaze-aware UI — visual output, no haptic
- Kangas haptic gaze 2014 — gaze-gesture trigger, handheld vibrotactile
- D'Mello Eye-Mind Reader 2020 — visual MW intervention, not haptic
- Sheet 1 FIG. 1 Trackpad finger view · force ripples 100
- Sheet 2 FIG. 2 Attention vs force curve · bookmark perturbation 200
- Sheet 2A FIG. 2A Time-domain perturbation envelope · ≤250 ms · ≤+30% 208
- Sheet 3 FIG. 3 Pipeline · gaze → attention → force-curve 300
- Sheet 4 FIG. 4 Force-curve calibration map 400
- Sheet 5 FIG. 5 Prior-art comparison matrix 500
- Sheet 6 FIG. 6 User-experience state machine 600
- Sheet 7 FIG. 7 Privacy boundary · on-device data-flow 700
- Sheet 8 FIG. 8 Reading-session timeline · 10-min trace 800
- 100sphysical objects (FIG. 1)
- 200scurve features & events (FIG. 2, 2A)
- 300spipeline blocks (FIG. 3)
- 400scalibration map (FIG. 4)
- 500sprior-art comparison (FIG. 5)
- 600sstate-machine nodes (FIG. 6)
- 700sprivacy boundary & data-flow (FIG. 7)
- 800ssession-timeline annotations (FIG. 8)
Part II · Drawings FIG. 1 – 8 · Sheets 1 – 9
Part III · Specification Field · Background · Summary · Brief description · Detailed description · Alternatives
- G06F 3/01 · haptic interfaces
- G06F 3/041 · touch surfaces
- G06F 3/0354 · pointing devices
- G06F 3/013 · gaze input
- G09B 17/00 · reading aids
Apple's Force Touch / haptic-trackpad family (US 10,162,447 B2 and related) covers the underlying actuator hardware and a class of force-curve UX primitives. Microsoft's Surface haptic line, Sensel, Tanvas Touch, and similar surface-haptic products cover analogous hardware spaces. Tobii and other gaze-tracking products drive visual UI changes, occasionally cursor changes, but not haptic curves.
Recent webcam-based mind-wandering work (Bixler & D'Mello 2016; Southwell et al. 2023) establishes that reading-attention state can be inferred on commodity hardware, and Eye-Mind Reader (D'Mello et al. 2020) closes that loop into a visual reading intervention. Gaze-event-triggered haptics on handheld devices (Kangas et al. 2014; Špakov et al. 2014) maps gaze events to brief vibrotactile pulses for auto-scroll gating.
The disclosed system claims a new bridge: a continuous, on-device, attention-density-driven modulation of the force-displacement curve of a Force-Touch-class trackpad, with a discrete disengagement perturbation superimposed only at threshold crossing. The bridge is the novel contribution; the actuator hardware and the upstream gaze inference are prior art.
Stated differently — and this is the load-bearing framing of the disclosure — the input device's own tactile response is repurposed as the calm-tech output surface, under a perceptual-floor bound. Prior reading-attention systems surface engagement feedback on a separate channel: a visual dashboard, a notification, a wearable buzz, or a hand-held fidget. Each of those introduces a new attention-grabbing surface alongside the input device. The disclosed system instead modulates the surface the user is already touching, which makes the feedback peripheral by construction; the user does not have to look elsewhere, switch context, or attend a separate notifier in order to receive it.
The disclosed system makes the haptic input device its own calm-tech output surface. A locally-inferred reader-attention index drives a continuous, perceptual-floor-bounded modulation of the device's force-displacement response, and a sustained crossing of a disengagement threshold by said index emits a single discrete force perturbation — the "haptic bookmark" — at the actuator. No separate display, notification, wearable, or accessory is recruited; the surface the user is already touching is the surface that delivers the feedback.
The system consumes the gaze-derived attention index supplied by the GazeStill parent disclosure (block 302 here, corresponding to GazeStill's gaze + density pipeline). A sliding-window attention estimator 304 produces a continuous attention index in [0, 1]. A force-curve mapper 306 applies a configurable look-up table (FIG. 4 · 402) to translate attention to a force-scaling factor, which is forwarded to the trackpad driver 308.
Independently, a disengagement-event side-channel 310 fires a discrete force perturbation when GazeStill's bookmark trigger is asserted, producing the haptic-bookmark sensation depicted at FIG. 2 · 206. The perturbation envelope is bounded above by the conscious-distraction threshold per Pohl 2019 and bounded below by the trackpad-force JND per Allin, Matsuoka & Klatzky 2002.
- FIG. 1Trackpad 102, finger 104, force 106, and gaze input 108.
- FIG. 2Attention 202 and force 204 curves with discrete perturbation 206 at the disengagement-threshold crossing (θ).
- FIG. 2ATime-domain shape of the perturbation envelope 208 / 210: rise < 30 ms, plateau ≈ 150 ms at ≤ 1.30×, fall < 30 ms.
- FIG. 3Pipeline blocks 302–310; baseline force-curve path and disengagement side-channel are separate.
- FIG. 4Calibration map 402 with perturbation envelope 404 superimposed at the low-attention end.
- FIG. 5Prior-art comparison matrix 502–520; PageHaptic 520 is the unique row satisfying all five criteria.
- FIG. 6Four-state user-experience model 602–610; perturbation 608 fires exactly on entry to DISENGAGED 606.
- FIG. 7Privacy boundary 700; frame buffer 704 discarded after fixation extraction; no network path 712 for raw frames or fixations.
- FIG. 8Annotated 10-minute reading-session timeline; attention 802 drifts, force-scaling ramps in anti-correlation, single perturbation 804 fires at θ_low crossing.
The host computing device of FIG. 3 · 300 may comprise, in some embodiments, a laptop computer with an integrated webcam and a Force-Touch-class trackpad. In some embodiments the trackpad comprises a linear-actuator assembly per Apple US 10,162,447 B2; in some embodiments the trackpad comprises an electrovibration surface per Bau et al. 2010 or a programmable-friction surface per Levesque et al. 2011. The disclosed method is independent of the underlying actuator technology and may be practiced on any haptic input device whose force-displacement response is software-modulable.
The webcam-derived gaze pipeline 302 operates entirely on-host. In some embodiments said pipeline comprises a neural-network gaze estimator per Krafka et al. 2016 or Zhang et al. 2015; in some embodiments it comprises a self-calibrating browser-only estimator per Papoutsaki et al. 2016. In all embodiments, raw camera frames are not retained beyond a single fixation-extraction step, and no raw image data leaves the host device.
The sliding-window attention estimator 304 produces a continuous reader-attention index in [0, 1] by integrating fixation density over the rendered document. In some embodiments the integration window is 30 seconds (claim 2); in some embodiments the window is 60 seconds; in some embodiments the window is adaptive to instantaneous reading speed estimated from fixation cadence. The disengagement threshold θ (FIG. 2, FIG. 2A) is configurable per user and, in some embodiments, is calibrated against an initial reading sample of fixed length.
The force-curve mapper 306 applies look-up table 402 (FIG. 4) to translate the attention index into a continuous force-scaling factor, in some embodiments bounded to [0.5, 1.5] of the host device's calibration baseline (claim 3). The mapping is monotonically decreasing in the baseline regime: higher attention yields lighter felt resistance. The mapping is user-configurable and may be replaced, in some embodiments, by a learned function (e.g. a small MLP) fitted to the user's own historical attention-trace.
The disengagement perturbation 310 / 404 / 208 is generated by a side-channel independent of the baseline force-curve path (FIG. 3). In some embodiments said perturbation envelope is rectangular as illustrated in FIG. 2A; in some embodiments it is sinusoidal; in some embodiments it is a raised-cosine or half-sine. The perturbation is distinct from a gaze-gesture-triggered haptic event in that its trigger is an integrated attention-density threshold crossing rather than a momentary saccade or fixation pattern (cf. Kangas et al. 2014, Špakov et al. 2014). The perturbation amplitude is bounded above by the conscious-distraction threshold per Pohl 2019 and below by the trackpad-force just-noticeable-difference per Allin, Matsuoka & Klatzky 2002.
In some embodiments the perceived resistance modulation includes a pseudo-haptic component per Lécuyer 2009, wherein the control–display ratio of scrolling is adjusted in concert with the actuator-force scaling factor, such that the felt lightness of scrolling is reinforced by visual scroll-velocity coupling. In such embodiments the recited force-displacement response of the trackpad encompasses both the physical actuator response and its perceptual counterpart.
- Actuator substrate. In some embodiments the trackpad is replaced by an electrovibration friction-modulation surface per Bau et al. 2010 (TeslaTouch), or a programmable-friction surface per Levesque et al. 2011, with the force-scaling factor (FIG. 4 · 402) replaced by an analogous friction-coefficient scaling factor.
- Perturbation envelope shape. In some embodiments the perturbation envelope is sinusoidal, half-sine, or raised-cosine, rather than the rectangular envelope of FIG. 2A · 208.
- Attention-estimator window. In some embodiments the sliding-window estimator (FIG. 3 · 304) operates with a 60-second window; in some embodiments with an adaptive window keyed to instantaneous reading speed; in some embodiments with a per-paragraph estimator that resets on each paragraph boundary.
- Force-curve mapper. In some embodiments the look-up table (FIG. 4 · 402) is replaced by a learned function — for example, a small multi-layer perceptron trained on the user's own historical attention/force pairs.
- Host form factor. In some embodiments the host computing device is replaced by a tablet computer with an integrated front camera and a haptic touchscreen, or by a head-mounted display with eye-tracking and a haptic controller. In such embodiments the trackpad-class haptic input device of claim 1 is read on the equivalent input surface of the host.
- Threshold calibration. In some embodiments the disengagement threshold (θ) is fixed; in some embodiments it is calibrated per user at first use; in some embodiments it adapts continuously based on within-session reading performance.
- Local trace logging. In some embodiments the system additionally persists the attention-index trace and disengagement events locally for the user's own later review, without transmitting them off-device (cf. FIG. 7 · 712).
Part IV · Claims 6 total · 1 indep · 4 dep · 1 apparatus
1. A computer-implemented method for continuously modulating the force-displacement response of a trackpad-class haptic input device of a host computing device as a function of a locally-inferred reader-attention state, comprising:
- (a)obtaining, from a webcam-derived gaze-fixation pipeline executing locally on said host computing device (302, per GazeStill parent), a stream of gaze fixations on a rendered long-form document;
- (b)computing on said host computing device a continuous reader-attention index by sliding-window integration of fixation density over the rendered document (304);
- (c)mapping said attention index via a configurable look-up table (306, FIG. 4 · 402) to a continuous force-scaling factor;
- (d)continuously applying said force-scaling factor to the force-displacement response of said trackpad (308), said modulation being sustained over time intervals exceeding the duration of any individual gaze fixation;
- (e)upon said reader-attention index crossing a configurable disengagement threshold (θ) for a sustained interval, generating a discrete force perturbation superimposed on the force-displacement response (310, 404, FIG. 2A · 208), said perturbation being distinct from any gaze-gesture-triggered haptic event; and
- (f)wherein both said continuous modulation of (d) and said discrete perturbation of (e) are, by construction, bounded above in magnitude and rate by a tactile perceptual-threshold floor (per FIG. 2A · 210, FIG. 4 · 402) such that the haptic input device remains peripheral to user attention rather than entering the foreground thereof.
2. The method of claim 1, wherein the attention index is computed per the GazeStill parent disclosure with sliding window of 30 seconds.
3. The method of claim 1, wherein the force-scaling factor lies in [0.5, 1.5] of the host device's calibration baseline.
4. The method of claim 1, wherein the discrete force perturbation has a temporal envelope comprising (i) a rise period not exceeding 30 ms, (ii) a plateau period of approximately 150 ms at amplitude not exceeding 1.30× the baseline force, and (iii) a fall period not exceeding 30 ms; and wherein the total envelope duration does not exceed 250 ms.
5. The method of claim 1, wherein the discrete force perturbation is configured (i) to exceed the just-noticeable difference for trackpad force as established by Allin, Matsuoka & Klatzky 2002, and (ii) to remain below the conscious-distraction threshold for subtle interaction as established by Pohl & Mottelson 2019; and wherein, in some embodiments, the modulation of the force-displacement response includes a pseudo-haptic component per Lécuyer 2009 in which the control–display ratio of scrolling is jointly adjusted with the force-scaling factor.
6. A host computing device comprising a webcam, a trackpad-class haptic input device, one or more processors, and non-transitory memory storing instructions which, when executed by the one or more processors, cause the host computing device to perform the method of any of claims 1 – 5.
| Claim | Key element | Supporting figures & numerals |
|---|---|---|
| 1(a) | webcam-derived gaze fixations, locally executed | FIG. 1 · 108 · FIG. 3 · 302 · FIG. 7 · 702, 706 |
| 1(b) | continuous attention index by sliding-window integration of fixation density | FIG. 2 · 202 · FIG. 3 · 304 · FIG. 7 · 708 · FIG. 8 · 802 |
| 1(c) | configurable look-up table mapping attention to force-scaling factor | FIG. 3 · 306 · FIG. 4 · 402 |
| 1(d) | continuous force-scaling sustained beyond any single fixation | FIG. 2 · 204 · FIG. 3 · 308 · FIG. 4 · 402 · FIG. 8 (lower panel) |
| 1(e) | discrete perturbation on disengagement-threshold crossing, distinct from gaze-gesture haptics | FIG. 2 · 206 · FIG. 2A · 208, 210 · FIG. 4 · 404 · FIG. 6 · 606, 608 · FIG. 8 · 804 |
| 1(f) | perceptual-threshold floor — modulation and perturbation remain peripheral, not foreground | FIG. 2A · 210 · FIG. 4 · 402 |
| 2 | 30-second sliding window | FIG. 3 · 304 |
| 3 | force-scaling factor in [0.5, 1.5] | FIG. 4 · 402 · FIG. 8 (Y-axis range) |
| 4 | perturbation envelope — rise ≤ 30 ms, plateau ≈ 150 ms at ≤ 1.30×, fall ≤ 30 ms, total ≤ 250 ms | FIG. 2A · 208, 210 |
| 5 | perceptual bounds (JND floor / conscious-distraction ceiling) + pseudo-haptic broadening | FIG. 2A (JND floor annotation) |
| 6 | host computing device · apparatus | FIG. 3 · 300 · FIG. 7 · 700 |
Part V · Appendices Reference numerals · Bibliography
- 102haptic trackpad
- 104finger
- 106variable force F(t)
- 108gaze input from GazeStill
- 202attention curve · gaze-derived
- 204trackpad force curve
- 206haptic bookmark · perturbation event
- 208perturbation envelope (time-domain)
- 210plateau region of envelope
- 602READING (engaged)
- 604DRIFTING
- 606DISENGAGED · bookmark-firing state
- 608bookmark fires on entry to 606
- 610RESUMING
- 300host device boundary
- 302webcam → gaze (GazeStill)
- 304sliding-window attention estimator
- 306force-curve mapper · LUT
- 308trackpad driver
- 310disengagement side-channel · detector
- 312perturbation envelope · generator
- 402baseline look-up table
- 404perturbation envelope (on attention axis)
- 502Apple Force Touch
- 504MS Surface haptic · Dial
- 506Tanvas · TeslaTouch
- 508Tobii gaze-aware UI
- 510WebGazer (Papoutsaki 2016)
- 512Sharmin gaze auto-scroll 2013
- 514Kangas haptic gaze 2014
- 516D'Mello Eye-Mind Reader 2020
- 518Southwell webcam MW 2023
- 520PageHaptic (this disclosure)
- 700host-device boundary
- 702webcam
- 704frame buffer · discarded
- 706fixation extractor
- 708attention index
- 710force-curve mapper + driver
- 712prohibited path · NO transmit
- 714cloud · out-of-scope
- 802attention-index trace
- 804bookmark-firing event (timestamped)
- Haptic trackpads · surface haptics
- Rosenberg, L. B. & Riegel, J. R. (Immersion Corporation). Haptic feedback for touchpads and other touch controls. US 6,429,846 B2 (2002) and continuations US 7,592,999 B2, US 8,031,181 B2, US 8,049,734 B2, US 8,059,105 B2, US 9,280,205 B2. [v1.0 audit add · foundational prior art on touchpad force-feedback modulation; Immersion holds 1,650+ haptic patents (2014 count); same Rosenberg inventor whose US7,429,108B2 / Outland Research is GazeStill's anticipating reference]
- Apple Inc. Force-Sensitive Input Device. US 10,162,447 B2.
- Apple Inc. Haptic Output Device with Force Curve Adjustment. US 20210390823 A1.
- Apple Inc. (Mulliken et al.). Stress-detection patent application. 2024. [v1.0 audit add · closest art on physiology→UI-modulation concept; sensor modality is EEG/HRV/gaze rather than fixation-density, output is notification/content rather than haptic force-curve]
- Bau, O., Poupyrev, I., Israr, A. & Harrison, C. TeslaTouch: Electrovibration for Touch Surfaces. UIST 2010.
- Levesque, V. et al. Enhancing Physicality in Touch Interaction with Programmable Friction. CHI 2011.
- Liao, Y.-C., Hsu, T.-W. et al. Haptic Feedback Design for a Virtual Button Along Force–Displacement Curves. UIST 2013.
- Tanvas, Inc. TanvasTouch development kit documentation. 2019.
- Webcam gaze · reading attention · mind-wandering
- Papoutsaki, A. et al. WebGazer: Scalable Webcam Eye Tracking Using User Interactions. IJCAI 2016.
- Bixler, R. & D'Mello, S. Automatic gaze-based user-independent detection of mind wandering during computerized reading. UMUAI 2016.
- D'Mello, S. et al. Eye-Mind Reader: an intelligent reading interface that promotes long-term comprehension by detecting and responding to mind wandering. Human–Computer Interaction 2020. [closest end-to-end analog · visual intervention vs PageHaptic's haptic intervention]
- Southwell, R., Mills, C., Caruso, M. & D'Mello, S. Webcam-Based Eye Tracking to Detect Mind Wandering and Comprehension Errors. Behavior Research Methods 2023. [webcam-only MW detection during reading]
- Rayner, K. Eye Movements in Reading and Information Processing: 20 Years of Research. Psychological Bulletin 1998.
- Gaze + haptic coupling · gaze-driven reading interfaces
- Kangas, J., Akkil, D., Rantala, J., Isokoski, P., Majaranta, P. & Raisamo, R. Gaze gestures and haptic feedback in mobile devices. CHI 2014; Haptic feedback to gaze events. ETRA 2014. [direct prior art on gaze-event-triggered haptics · gesture-driven, handheld vibrotactile]
- Špakov, O., Isokoski, P. & Majaranta, P. Effects of haptic feedback on gaze-based auto-scrolling. NordiCHI 2014.
- Sharmin, S., Špakov, O. & Räihä, K.-J. Reading on-screen text with gaze-based auto-scrolling. ETRA SA 2013.
- Attentive UI · calm computing · subtle interaction
- Vertegaal, R. Attentive User Interfaces. CACM 46(3), 2003.
- Weiser, M. The Computer for the 21st Century. Scientific American, Sept. 1991.
- Pohl, H. & Mottelson, A. Charting Subtle Interaction in the HCI Literature. CHI 2019.
- Haptic psychophysics · pseudo-haptics
- Allin, S., Matsuoka, Y. & Klatzky, R. Measuring Just Noticeable Differences for Haptic Force Feedback. IEEE HAPTICS 2002.
- Lécuyer, A. Simulating Haptic Feedback Using Vision: A Survey of Pseudo-Haptic Feedback. Presence 2009.
- Parent disclosure
- Kim, J. H. GazeStill. Provisional draft v0.2 (card-centered; parent application).
Part VI · Execution Version · v1.0 · Timeline + alternatives + claim chart
- v0.12026-04-28 · Skeleton draft. Descendant of GazeStill.
- v0.22026-05-05 · Added drawing-convention legend, FIG. 2A (time-domain envelope) and FIG. 5 (prior-art matrix); reference-numerals appendix; detailed description; narrowed Claim 1 to trackpad / continuous / non-gesture; bibliography expanded with Southwell 2023, Kangas 2014, D'Mello 2020.
- v0.32026-05-12 · Added FIG. 6 (state machine) and FIG. 7 (privacy boundary); Field of Invention promoted to its own block; lineage breadcrumb at top; Distinguished-from sidebar legibility fix; section dividers strengthened; Claims box hierarchy bumped; Claim 5 added (perceptual bounds + pseudo-haptic); FIG. 1 force-arrow / gaze-line geometry corrected.
- v1.02026-05-18 · Added FIG. 8 (annotated 10-min session timeline tying together FIG. 2, 4, 6); Alternative Embodiments block (7 named broadenings, MPEP § 608.01(g)); Claim · figure support chart cross-referencing every claim step to figures and reference numerals; ref-numerals appendix gained 800s group.
This descendant cites the GazeStill parent specification (see /gazestill) for the attention-inference primitive and adds one narrow claim group (force-curve modulation + disengagement perturbation).