About the DEX8 Platform

Here, we will briefly try to explain what the DEX8 Platform is and how you can use it.

Platform Description

DEX8 Serverless Platform    DEX8 is a serverless platform primarily designed for data extraction, web scraping, data mining, and various types of process automation, especially browser automation. Moreover, as a serverless platform, it can be leveraged for any type of task, providing huge flexibility and scalability.

DEX8 is a robust, decentralized, and highly scalable solution powered by our innovative technology.

It is a platform where you can write a script in JavaScript, save it, and then execute it on numerous servers. Each of these servers is referred to as a DEX8 Worker. The DEX8 platform enables the same script to be executed simultaneously on multiple workers, allowing it to process large amounts of data in a very short period of time. This decentralized approach enables the execution of scripts with very high CPU/RAM capacity, making its possibilities almost limitless.
Decentralised DEX8 Workers

DEX8 Core Components

  1. Web Panel
    • Web Panel is a user interface where users can log in, write scripts, and execute scripts on remote servers (workers).
    • The Web Panel can be accessed at https://panel.dex8.com, but you need to create an account first.
    • If you want to try a demo account, please send us a demo request here.
  2. Core API
    • Core API is an HTTP server that receives HTTP requests and returns responses. It enables communication between the panel and workers.
  3. Core WS API
    • Core WS API is a websocket server that sends and receives messages in real-time. Internally, we named them echo messages.
  4. Worker
    • A worker is a server on which an application is installed that can execute scripts.
    • Each worker has a unique IP address, which can be extremely important for web scraping tasks.

Platform Features

  • Script coding: Writing, editing, and deleting script files. Within our internal terminology, the term 'skripts' is used to refer to scripts.
  • Script execution: Easily starting, pausing, and stopping scripts with a single click on the START, STOP, PAUSE, RESUME buttons. Simultaneously running a single script on multiple workers.
  • Script monitoring: In addition to sending error notifications to the panel, the worker also sends real-time messages. These messages are called "echo messages" and are transmitted to the web panel in real time via WebSocket.
  • Scheduler: Allows you to define when a specific script will run on a specific worker. This enables automatic starting, stopping, or pausing of scripts using defined cron jobs.
  • Storage:
    • MongoDB: Saving extracted data to a MongoDB database. Viewing, editing, and deleting collected data.
    • PostgreSQL: Saving extracted data to a PostgreSQL database. Viewing, editing, and deleting collected data.
  • Exporters: Exporting collected data from the database to CSV or from CSV to the database.
  • Joint API: This API allows you to connect your application to the DEX8 platform.

Intended Use

Unlike other data extraction services, DEX8 offers a vastly superior range of capabilities.
The DEX8 is primarily designed for data extraction, data mining, and web scraping. Moreover, it excels in browser automation and can be customized for a myriad of other automation tasks.
This versatility makes DEX8 a flexible platform that can be tailored to any organization's unique needs.

Programming Language

The programming language used for writing scripts (DEX8 Skripts) is JavaScript, and we allow the use of any npm library.
We are actively working on integrating Python.

Advantages

  • No Software Installation No Software Installation

    DEX8 operates entirely in the Cloud, ensuring easy accessibility via a user-friendly Web Panel.

  • Huge Operating Capacity Huge Operating Capacity

    Scale your operations effortlessly with DEX8 Workers and gain unlimited processing power.

  • Real-time Monitoring Real-time Monitoring

    Gain complete visibility into the execution of your scripts with real-time monitoring. Track progress, identify potential issues, and ensure smooth operations.

  • Error Reporting Error Reporting

    Gain valuable insights into errors that occur during script execution. Receive detailed error messages and logs, enabling you to quickly identify and resolve issues, minimizing downtime and maximizing efficiency.

  • Infinite Workers Infinite Workers

    Effortlessly scale your processing power by deploying a virtually unlimited number of workers. Handle massive workloads and demanding tasks with ease, ensuring your projects are completed quickly and efficiently.

  • Data Storage Data Storage

    Choose the SQL or NoSQL the platform database as data storage solution that best fits your needs. Store your valuable extracted data securely and efficiently in either MongoDB (NoSQL) or PostgreSQL (SQL). These robust databases provide flexibility and scalability for all your data storage requirements.

  • Scheduling Scheduling

    Automate your data extraction processes with ease. Easily define cron jobs with a few clicks to schedule your scripts to run at precise times or intervals. Save time and effort by automating repetitive tasks and ensuring data is collected consistently and reliably.

  • Exporter Data Exporters

    Effortlessly transfer your data between different formats. Easily export extracted data from your database to CSV files for further analysis or import CSV files directly into your database. This flexibility allows you to seamlessly integrate your data with other tools and applications.

  • Joint API Joint API

    Integrate DEX8 into your existing applications and workflows using our specially designed API endpoints. Leverage the power of DEX8 features like data extraction, automation, and scheduling directly within your own software.