Error trying to run FindMarkers using future (in parallel)

Question

[kyle.mcandrews]

Hi everyone, trying to run the FindMarkers function with Seurat running parallel using the future package (just got a mobile workstation with i9 12th gen processor and currently at 80gb ram)

library(future)

plan(multisession, workers = 24)

options(future.globals.maxSize= 999999999999999999999999999999999999999999999999999999999999999)

Cluster0 <- FindMarkers(int, "0")

Error: MultisessionFuture (future_sapply-7) failed to call gassign() on cluster RichSOCKnode #7 (PID 27772 on localhost ‘localhost’). The reason reported was ‘error writing to connection’. Post-mortem diagnostic: Failed to determined whether a process with this PID exists or not, i.e. cannot infer whether localhost worker is alive or not. The total size of the 7 globals exported is 933.96 MiB. The three largest globals are ‘data.use’ (933.92 MiB of class ‘S4’), ‘j’ (20.03 KiB of class ‘numeric’) and ‘...future.FUN’ (14.94 KiB of class ‘function’)

When I switch to plan(sequential), it runs fine, but takes forever. My dataset has ~25,000 cells and 8 clusters ranging from 600-5000 cells a piece.

New to running things in parallel and a novice at R and Seurat in general.

Any help would be appreciated!