Light-Intensity Modulated (LIM) force sensors are seeing increasing interest in the field of surgical robotics and flexible systems in particular. However, such sensing modalities are notoriously susceptible to ambient effects such as temperature and environmental irradiance which can register as false force readings. We explore machine learning techniques to dynamically compensate for environmental biases that plague multi-axis optoelectronic force sensors. In this work, we fabricate a multisensor: three-axis LIM force sensor with integrated temperature and ambient irradiance sensing manufactured via a monolithic, origami-inspired fabrication process called printed-circuit MEMS. We explore machine learning regression techniques to compensate for temperature and ambient light sensitivity using on-board environmental sensor data. We compare batch-based ridge regression, kernelized regression and support vector techniques to baseline ordinary least-squares estimates to show that on-board environmental monitoring can substantially improve sensor force tracking performance and output stability under variable lighting and large (>100C) thermal gradients. By augmenting the least-squares estimate with nonlinear functions describing both environmental disturbances and cross-axis coupling effects, we can reduce the error in Fx, Fy and Fz by 10%, 33%, and 73%, respectively. We assess viability of each algorithm tested in terms of both prediction accuracy and computational overhead, and analyze kernel-based regression for prediction in the context of online force feedback and haptics applications in surgical robotics. Finally, we suggest future work for fast approximation and prediction using stochastic, sparse kernel techniques.
Recent advances in medical robotics have initiated a transition from rigid serial manipulators to flexible or continuum robots capable of navigating to confined anatomy within the body. A desire for further procedure minimization is a key accelerator for the development of these flexible systems where the end goal is to provide access to the previously inaccessible anatomical workspaces and enable new minimally invasive surgical (MIS) procedures. While sophisticated navigation and control capabilities have been demonstrated for such systems, existing manufacturing approaches have limited the capabilities of millimeter-scale end-effectors for these flexible systems to date and, to achieve next generation highly functional end-effectors for surgical robots, advanced manufacturing approaches are required. We address this challenge by utilizing a disruptive 2D layer-by-layer precision fabrication process (inspired by printed circuit board manufacturing) that can create functional 3D mechanisms by folding 2D layers of materials which may be structural, flexible, adhesive, or conductive. Such an approach enables actuation, sensing, and circuitry to be directly integrated with the articulating features by selecting the appropriate materials during the layer-by-layer manufacturing process. To demonstrate the efficacy of this technology, we use it to fabricate three modular robotic components at the millimeter-scale: (1) sensors, (2) mechanisms, and (3) actuators. These modules could potentially be implemented into transendoscopic systems, enabling bilateral grasping, retraction and cutting, and could potentially mitigate challenging MIS interventions performed via endoscopy or flexible means. This research lays the ground work for new mechanism, sensor and actuation technologies that can be readily integrated via new millimeter-scale layer-by-layer manufacturing approaches.
The innovation in surgical robotics has seen a shift toward flexible systems that can access remote locations inside the body. However, a general reliance on the conventional fabrication techniques ultimately limits the complexity and the sophistication of the distal implementations of such systems, and poses a barrier to further innovation and widespread adoption. In this paper, we present a novel, self-assembling force sensor manufactured using a composite lamination fabrication process, wherein linkages pre-machined in the laminate provide the required degrees-of-freedom and fold patterns to facilitate self-assembly. Using the purely 2-D fabrication techniques, the energy contained within a planar elastic biasing element directly integrated into the laminate is released post-fabrication, allowing the sensor to self-assemble into its final 3-D shape. The sensors are batch-fabricated, further driving down the production costs. The transduction mechanism relies on the principle of light intensity modulation, which allows the sensor to detect axial forces with millinewton-level resolution. The geometry of the sensor was selected based on the size constraints inherent in minimally invasive surgery, as well as with a specific focus on optimizing the sensor's linearity. The sensor is unique from the fiber-based force sensors in that the emitter and the detector are encapsulated within the sensor itself. The bare sensor operates over a force range of 0-200 mN, with a sensitivity of 5 V/N and a resolution of 0.8 mN. The experimental results show that the sensor's stiffness can be tuned using a thicker material for the spring layer and/or encapsulation/integration with soft materials. The empirical validation shows that the sensor has the sensitivity and the resolution necessary to discern the biologically relevant forces in a simulated cannulation task.
Closing small defects in the body typically requires stitching of tissues during surgery. Toward a minimally invasive approach, Roche et al. engineered a balloon catheter with a reflective surface coating that could be used to adhere biodegradable patches to tissues. The device unfolds the patch and its adhesive, delivers ultraviolet (UV) light, and then applies pressure to stabilize the adhesive as the light cures the polymer. The authors demonstrated catheter-mediated application of the photocurable polymer patch in vivo in rat tissue, with minimal inflammation and complete animal survival, as well as in a challenging septal defect in the beating hearts of pigs. The device was also used to seal porcine stomach ulcers and abdominal hernias ex vivo, suggesting versatility of this approach in repairing defects more easily and atraumatically than sutures.A congenital or iatrogenic tissue defect often requires closure by open surgery or metallic components that can erode tissue. Biodegradable, hydrophobic light-activated adhesives represent an attractive alternative to sutures, but lack a specifically designed minimally invasive delivery tool, which limits their clinical translation. We developed a multifunctional, catheter-based technology with no implantable rigid components that functions by unfolding an adhesive-loaded elastic patch and deploying a double-balloon design to stabilize and apply pressure to the patch against the tissue defect site. The device uses a fiber-optic system and reflective metallic coating to uniformly disperse ultraviolet light for adhesive activation. Using this device, we demonstrate closure on the distal side of a defect in porcine abdominal wall, stomach, and heart tissue ex vivo. The catheter was further evaluated as a potential tool for tissue closure in vivo in rat heart and abdomen and as a perventricular tool for closure of a challenging cardiac septal defect in a large animal (porcine) model. Patches attached to the heart and abdominal wall with the device showed similar inflammatory response as sutures, with 100% small animal survival, indicating safety. In the large animal model, a ventricular septal defect in a beating heart was reduced to <1.6 mm. This new therapeutic platform has utility in a range of clinical scenarios that warrant minimally invasive and atraumatic repair of hard-to-reach defects.
This paper details the design, analysis, fabrication, and validation of a deployable, atraumatic grasper intended for retraction and manipulation tasks in manual and robotic minimally invasive surgical (MIS) procedures. Fabricated using a combination of shape deposition manufacturing (SDM) and 3D printing, the device (which acts as a deployable end-effector for robotic platforms) has the potential to reduce the risk of intraoperative hemorrhage by providing a soft, compliant interface between delicate tissue structures and the metal laparoscopic forceps and graspers that are currently used to manipulate and retract these structures on an ad hoc basis. This paper introduces a general analytical framework for designing SDM fingers where the desire is to predict the shape and the transmission ratio, and this framework was used to design a multijointed grasper that relies on geometric trapping to manipulate tissue, rather than friction or pinching, to provide a safe, stable, adaptive, and conformable means for manipulation. Passive structural compliance, coupled with active grip force monitoring enabled by embedded pressure sensors, helps to reduce the cognitive load on the surgeon. Initial manipulation tasks in a simulated environment have demonstrated that the device can be deployed though a 15 mm trocar and develop a stable grasp using Intuitive Surgical's daVinci robotic platform to deftly manipulate a tissue analog.