Upload Custom Made 3D Surface Models of Tumors​

3D Surface models of tumors, created in the Brainlab Elements software, can be uploaded to Lumi in STL format and added to a Hologram for 3D Augmented Reality visualization.

• Note: The conversion between original voxel-based 3D segmentation objects and the exported STL models from the Brainlab Elements software may lead to loss of information due to voxel interpolation effects. Therefore, please carefully inspect any imported STL model in Lumi. For more instructions, check Verify Hologram.

• Note: STL models must be uploaded and associated only with the exact same scan from which they were created.

• Note: Although, the STL format is a general format in the field of medical 3D imaging, the Lumi software only allows for the import of STL models created using Brainlab Elements.

​

Uploading and visualizing an STL file involves two general steps: uploading the STL file/model to the Lumi cloud (steps 1-2) and adding the STL file/model to a hologram (steps 3-6). The steps are as follows:

1. Open an existing patient in the Lumi web application. In the Study or Hologram hierarchy level (see figure below), use the 'Add' button to select one or multiple STL files. Alternatively, you can drag and drop STL models into the dropzone on the ‘Add’ button. Notes:

   • An STL model can only be added to an existing patient.

   • STL models can only be uploaded using the Lumi web application, e.g. not in the Lumi HL2 application.

2. A list of all selected STL models will be shown in a dialog window which allow users to rename the STL model and/or choose a template for the 3D model before the data (STL model) is uploaded and stored in the Lumi cloud. Once users have chosen the desired name and template, the STL models will be uploaded and saved in Lumi as a 3D Surface model. Note:

   • Users can always change the name, template, or color later if needed.

3. To use or view the 3D Surface models, they must be added to a Hologram entity. Open a Hologram entity, press the ‘+’ button, and select ‘Import Model (STL).’

4. In the 'Select Surface' dialog window, a list of all available 3D Surface models within the patient will appear. Clicking on a 3D Surface model in this list will display a preview of the 3D Surface model in the 3D viewer. The Lumi software automatically proposes the 3D model preview in the correct coordinate system and scale. When you verify that the coordinate system is correct, clicking the ‘Add’ button will add the selected 3D Surface models to the Hologram entity, and the preview pop up window will close. Notes:

   • If the 3D Surface model is not placed in the correct coordinate system, you can select a different coordinate system from a dropdown list, and the 3D Surface model preview will adjust accordingly for verification.

   • If the proposed scale of the 3D Surface model is incorrect (e.g., in millimetres instead of meters), you can select a different scale (mm, cm, or meter), and the scale will update for verification.

5. The imported 3D Surface model will be added as a Component to the Hologram entity menu, with the same functionalities as any other 3D Surface model (e.g., a 3D Surface model created using the semi-automatic segmentation function). Notes:

   • Users can change the color, adjust transparency, or use the draw and shape edit functionalities, among other options.

   • This means users can visualize the 3D Surface model and their outline on the medical scans for verification purpose.

6. When the new 3D models are added to the Hologram entity, the verification state of the Hologram entity will be set to ‘Unverified,’ just as it is when a semi-automatic segmentation is completed. Using the verification workflow (see the verification workflows page), you can inspect the 3D model’s accuracy by viewing its outline as a contour on the scan slices. Additionally, the verification workflow allows for direct adjustments (shape edit) in case any inconsistencies are detected. Once the verification workflow is complete and the added 3D Surface model(s) are individually verified, the verification state of the Hologram will change to ‘Verified.’