云环境下时空任务交互式编排与增量计算方法研究

Research on Interactive Spatio-Temporal Task Orchestration and Incremental Computing Methods in Cloud Environments

  • 摘要: 云环境下,遥感云计算平台通常基于代码脚本灵活调用与自由组合时空算子来实现任务编排,从而提供多样化的遥感分析功能。地学问题的复杂性与不确定性促使人们将问题拆分为若干易于解决的子问题逐个求解。然而,现有的任务编排方法侧重于问题的整体建模,难以支撑时空任务的分阶段局部构建与迭代调整,此外,在交互式场景下会产生大量逻辑相似的任务流程,并被提交到云端执行导致冗余计算。为此,设计了一种时空任务交互式计算框架,并从计算资源高效利用的需求出发,提出了时空任务靶向重构的增量式计算方法。在框架层面,围绕时空任务的构建-演化-执行的全生命周期,将时空任务的编排过程自上而下划分为抽象概要层,逻辑实例层,物理执行层三级编排空间,设计了适应用户交互行为的时空任务形式化表达模型与动态构建策略;在方法层面,动态感知时空任务建模过程中的流程演化,分析新旧任务间的拓扑结构差异,揭示交互式编排场景中变更操作的影响路径,进而对时空任务迭代重构并复用中间结果实现增量计算。最后,基于开放地球引擎(OGE)平台实现了提出方法,并结合具体案例,验证了方法的可行性,定量结果表明,与传统全流程提交方法相比,本文方法可降低40%– 60%的计算冗余,平均任务执行时间减少35%左右

     

    Abstract: Objectives: Under cloud computing environments, remote sensing cloud computing platforms typically achieve task orchestration by flexibly invoking and freely combining spatiotemporal operators through code scripts, thereby providing diversified remote sensing analysis capabilities. The complexity and uncertainty of geospatial problems prompt researchers to decompose problems into several easily solvable subproblems for step-by-step solving. However, existing task orchestration methods primarily focus on holistic problem modeling, making it difficult to support phased local construction and iterative adjustment of spatiotemporal tasks. Furthermore, in interactive scenarios, they tend to generate numerous task flows with similar logic that are submitted to the cloud for execution, resulting in redundant computations. Methods: A spatiotemporal task interactive computing framework has been designed. To address the demand for efficient computing resource utilization, an incremental computing method for spatiotemporal task targeted reconstruction is proposed. At the framework level, spanning the entire lifecycle of spatiotemporal task construction, evolution, and execution, the orchestration process is top-down divided into three orchestration spaces: the abstract overview layer, the logical instance layer, and the physical execution layer. A formal expression model and dynamic construction strategy for spatiotemporal tasks, adaptable to user interaction behaviors, are designed. At the methodological level, we precisely identify newly added/deleted/modified vertices and their associated dependency edges through graph structural difference analysis. By tracing propagation paths using breadth-first search, we locate the boundaries of subgraphs affected by vertex changes, extracting logically changed subgraphs and logically unchanged subgraphs to reconstruct task logic. For logically unchanged subgraphs, we directly match them with historical task flow graphs and reuse their execution results. For logically changed subgraphs, we add input data vertices and associate them with execution results from unchanged subgraphs. This constructs a new spatio-temporal task flow graph, forming a local spatio-temporal task execution plan. Results: The implementation was based on the Open Geospatial Engine (OGE) platform. Through specific case studies, the feasibility of the method was validated. Quantitative results indicate that compared to traditional fullprocess submission methods, the proposed approach reduces computational redundancy by 40%-60% and decreases average task execution time by approximately 35%. Conclusions: The incremental computation method based on task graph structure-targeted reconstruction demonstrates broad applicability across tasks with varying computational characteristics. It effectively reduces computational redundancy and enhances task execution efficiency for diverse interactive behaviors, such as vertex insertion/deletion and dependency relationship adjustments. Furthermore, when handling large-scale data processing tasks, this approach holds significant value in reducing memory resource consumption and improving system stability.

     

/

返回文章
返回