Visual Perception and Control of Underwater Robots
Research BackgroundReview of Underwater Visual RestorationFormation of Underwater ImageVisual Restoration Based on Image Formation ModelVisual Restoration Based on Information FusionReview of Deep-Learning-Based Object DetectionTwo-Stage DetectorRCNNFast RCNNFaster RCNNRFCNSingle-Stage DetectorYOLOSSDRetinaNetRefineDetTemporal Object DetectionPost-ProcessingCascade of Detection and TrackingFeature Fusion Based on Motion EstimationFeature Propagation Based on RNNTemporally Sustained ProposalBatch-ProcessingBenchmarks of Object DetectionPASCAL VOCMS COCOImageNet VIDEvaluation MetricsREVIEW OF UNDERWATER STEREO MEASUREMENTOverview of the Subsequence ChaptersReferencesAdaptive Real-Time Underwater Visual Restoration with Adversarial Critical LearningIntroductionReview of Visual Restoration and Image-to-Image TranslationTraditional Underwater Image Restoration MethodsImage-to-Image TranslationGAN-Based Restoration with Adversarial Critical LearningFiltering-Based Restoration SchemeArchitecture of the GAN-Based Restoration SchemeObjective for GAN-RSAdversarial LossDCP LossUnderwater Index LossFull LossExperiments and DiscussionDetails of ACLBasic SettingsMultistage Loss StrategyCompared MethodsRuntime PerformanceRunning EnvironmentTime EfficiencyRestoration ResultsVisualization of Underwater IndexComparison on Restoration QualityFeature-Extraction TestsVisualization of DiscriminatorDiscussionConcluding RemarksReferencesA NSGA-II-Based Calibration for Underwater Binocular Vision MeasurementIntroductionRelated WorkRefractive Camera ModelAkin Triangulation and Refractive ConstraintAkin TriangulationRefractive Surface ConstraintCalibration AlgorithmA Novel Usage of CheckerboardAnalysis of the Binocular Housing ParametersNSGA-II AlgorithmProcess of the Calibration AlgorithmExperiments and ResultsExperimental SetupResults of CalibrationExperiments on Position MeasurementExperiments on Position MeasurementDiscussionConclusion and Future WorkReferencesJoint Anchor-Feature Refinement for Real-Time Accurate Object Detection in Images and VideosIntroductionReview of Deep Learning-Based Object DetectionCNN-Based Static Object DetectionTemporal Object DetectionSampling for Object DetectionDual Refinement NetworkOverall ArchitectureAnchor-Offset DetectionFrom SSD to RefineDet, then to DRNetAnchor RefinementDeformable Detection HeadFeature Location RefinementMulti-deformable HeadTraining and InferenceTemporal Dual Refinement NetworksArchitectureTrainingInferenceExperiments and DiscussionAblation Studies of DRNet320-VGG16 on VOC 2007Anchor-Offset DetectionMulti-deformable HeadToward More Effective TrainingResults on VOC 2007Results on VOC 2012Results on COCOResults on ImageNet VIDAccuracy vs. Speed Trade-offComparison with Other ArchitecturesDiscussionConcluding RemarksReferencesRethinking Temporal Object Detection from Robotic PerspectivesIntroductionReview of Temporal Detection and TrackingOn VID Temporal PerformanceNon-reference AssessmentsRecall ContinuityLocalization StabilityOnline Tracklet RefinementSOT-by-DetectionSmall-Overlap SuppressionSOT-by-Detection FrameworkExperiments and DiscussionAnalysis on VID Continuity/StabilityTracklet VisualizationNumerical EvaluationSOT-by-DetectionSpeed Comparison of NMS and SOS-NMSSOT-by-Detection vs. Siamese SOTDiscussionConcluding RemarksReferencesReveal of Domain Effect: How Visual Restoration Contributes to Object Detection in Aquatic ScenesIntroductionReview of Underwater Visual Restoration and Domain-Adaptive Object DetectionUnderwater Visual RestorationDomain-Adaptive Object DetectionPreliminaryPreliminary of Data Domain Based on Visual RestorationDomain GenerationDomain AnalysisPreliminary of DetectorJoint Analysis on Visual Restoration and Object DetectionWithin-Domain PerformanceNumerical AnalysisVisualization of Convolutional RepresentationPrecision-Recall AnalysisCross-Domain PerformanceCross-Domain EvaluationCross-Domain TrainingDomain Effect on Real-World Object DetectionOnline Object Detection in Aquatic ScenesOnline Domain AnalysisDiscussionUnderwater Vision System and Marine TestSystem DesignUnderwater Object CountingUnderwater Object GraspingConcluding RemarksReferencesIWSCR: An Intelligent Water Surface Cleaner Robot for Collecting Floating GarbageIntroductionPrototype Design of IWSCRConfiguration of IWSCRFramework of Control SystemACCURATE AND REAL-TIME GARBAGE DETECTIONSliding Mode Controller for Vision-Based SteeringDynamic Model of Underwater VehicleFormulation of the Vision-Based SteeringDesign and Stability Analysis of Sliding Mode ControllerDynamic Grasping Strategy for Floating BottlesKinematics and Inverse Kinematics of ManipulatorDescription of the Feasible Grasping StrategyExperiments and DiscussionExperimental Results of Garbage DetectionExperimental Results of SMC for Vision-Based Steering and Achievement of TTsDiscussionCONCLUSION AND FUTURE WORKReferencesUnderwater Target Tracking Control of an Untethered Robotic Fish with a Camera StabilizerIntroductionSystem Design of the Robotic Fish with a Camera StabilizerMechatronic DesignCPG-Based Motion ControlActive Vision Tracking SystemRL-Based Target Tracking ControlTracking Control DesignPerformance Analysis of DDPG-Based Control SystemExperiments and ResultsStatic and Dynamic Tracking ExperimentsDiscussionConclusions and Future WorkReferences