Image Segmentation Using Deep Learning: A Survey
Ieee account.
- Change Username/Password
- Update Address
Purchase Details
- Payment Options
- Order History
- View Purchased Documents
Profile Information
- Communications Preferences
- Profession and Education
- Technical Interests
- US & Canada: +1 800 678 4333
- Worldwide: +1 732 981 0060
- Contact & Support
- About IEEE Xplore
- Accessibility
- Terms of Use
- Nondiscrimination Policy
- Privacy & Opting Out of Cookies
A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. © Copyright 2024 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.
An official website of the United States government
The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.
The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.
- Publications
- Account settings
- Advanced Search
- Journal List
A Survey of Brain Tumor Segmentation and Classification Algorithms
Erena siyoum biratu.
1 College of Electrical and Mechanical Engineering, Addis Ababa Science and Technology University, Addis Ababa 120611, Ethiopia; moc.liamg@muoyisanari (E.S.B.); moc.liamg@amrigeyat (T.G.D.)
Friedhelm Schwenker
2 Institute of Neural Information Processing, Ulm University, 89081 Ulm, Germany
Yehualashet Megersa Ayano
3 Ethiopian Artificial Intelligence Center, Addis Ababa 40782, Ethiopia; moc.liamg@nevuelauhey
Taye Girma Debelee
Associated data.
Not applicable.
A brain Magnetic resonance imaging (MRI) scan of a single individual consists of several slices across the 3D anatomical view. Therefore, manual segmentation of brain tumors from magnetic resonance (MR) images is a challenging and time-consuming task. In addition, an automated brain tumor classification from an MRI scan is non-invasive so that it avoids biopsy and make the diagnosis process safer. Since the beginning of this millennia and late nineties, the effort of the research community to come-up with automatic brain tumor segmentation and classification method has been tremendous. As a result, there are ample literature on the area focusing on segmentation using region growing, traditional machine learning and deep learning methods. Similarly, a number of tasks have been performed in the area of brain tumor classification into their respective histological type, and an impressive performance results have been obtained. Considering state of-the-art methods and their performance, the purpose of this paper is to provide a comprehensive survey of three, recently proposed, major brain tumor segmentation and classification model techniques, namely, region growing, shallow machine learning and deep learning. The established works included in this survey also covers technical aspects such as the strengths and weaknesses of different approaches, pre- and post-processing techniques, feature extraction, datasets, and models’ performance evaluation metrics.
1. Introduction
Machine learning has been applied in different sectors, the majority of the studies indicate that it was applied in agriculture [ 1 ], and health sectors [ 2 , 3 ] for disease detection, prediction, and classifications. In health sectors the most researched areas are breast cancer segmentation and classification [ 4 , 5 , 6 , 7 ], brain tumor detection and segmentation [ 8 ], and lung and colon cancer segmentation and classification [ 3 ].
The gold standard in brain tumor diagnosis is biopsy which includes resection and pathological examination using various cellular (histologic) examination techniques. However, the diagnosis using biopsy is invasive that may result in bleeding and even injury that results in functional loss [ 9 ]. As a result, non-invasive brain tumor diagnosis using magnetic resonance imaging is the mainstay of modern neuroimaging that enables physician to characterize structural, cellular, metabolic, and functional properties of brain tumor [ 9 , 10 ].
In a conventional structural MRI scan, a healthy brain contains white mater (WM), gray matter (GM), cerebrospinal fluid (CSF) [ 11 ]. The main variation of these tissues in a structural MRI scan depends on their water content. The white matter (WM), which is 70% water, is a myelinated axon that connects the cerebral cortex with other brain regions. Furthermore, it carries information between neurons and connects the right and left hemispheres of the brain. The gray matter, which is 80% water, contains neuronal and glial cells that control brain activity, and the basal nuclei which are located deep within the white matter. Whereas, the cerebrospinal fluid is almost 100% water, and fills the space between the infoldings of the brain, between the brain and skull, and between the ventricular system in the brain[ 11 , 12 ].
Clinically, due to the variability in size, locality, rate of growth, and pathology, it is difficult to understand the manifestation of a brain tumor. However, a brain tumor is an abnormal mass of tissue, in which some cells grow and multiply uncontrollably. This uncontrollable growth takes up space within the skull and interferes with normal brain activity and damages the brain cells. The damage may be caused through increasing pressure in the brain, by shifting the brain or pushing against the skull, and by invading nerves and healthy brain tissues [ 13 , 14 ]. Different criteria can be used to classify brain tumor. A layered based tumor classification schema that has been proposed by WHO provides a detailed classification techniques that is more pertinent to radiological use. In this schema the hierarchy from top to bottom four layers, that are, final integrated diagnosis, histologic classification, WHO grade, molecular information [ 15 ]. However, brain tumors can be more generally grouped into primary and secondary (metastatic) tumors depending on their place of origin [ 16 ]. Primary brain tumors originates in the brain itself and are named for the cell types from which they originated. These primary tumors can be benign (non-cancerous) and malignant (cancerous). Benign tumors grow slowly and do not spread elsewhere or invade the surrounding tissues. However, they can put pressure on the brain and compromise its function. On the contrary, the malignant tumors grow rapidly and spread to surrounding tissues. On the other hand, secondary brain tumors originate from another part of the body. These tumors mainly occur due to cancer cells from somewhere else in the patient’s body that spread to the brain. The most common causes of secondary brain tumors are lung cancer, breast cancer, melanoma, kidney cancer, bladder cancer, certain sarcomas, and testicular and germ cell tumors [ 13 , 16 , 17 ]. Each of these tumors has unique clinical, radiographic, and biological characteristics [ 13 ].
In MRI scanning, brain examination can be normal or abnormal. The normal brain tissues in MRI are characterized by gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF) tissues. Apart from the normal tissues listed earlier the tumorous brain scan often contains core tumor, necrosis, and edema. Necrosis is a dead cell located inside a core tumor, while edema is located near active tumor borders. Edema is a swelling that exists due to trapped fluids around a tumor. It can be vasogenic in non-infiltrative extra-axial tumors, such as meningioma, or it can be infiltrative that invades WM tracts of a brain in tumors, such as glioma [ 10 , 18 ]. Furthermore, these tissues often have indistinguishable intensity features in structural MRI sequences, such as T1-w, T2-w, FLAIR. For instance, the difficulty in differentiating between the core tumor and associated inflammation was discussed [ 19 ]. In addition to that, Alves et al. [ 19 ] demonstrated the difficulty in differentiating tumors using signal intensities alone. They demonstrated using a case where two patients were diagnosed with two different brain tumor types due to both tumors have similar intensity features and both are surrounded by extensive edema.
1.1. Brain Tumor Imaging Modalities
There are a variety of imaging techniques used to study brain tumors, such as magnetic resonance imaging (MRI), computed tomography (CT), positron emission tomography (PET), and single-photon emission computed tomography (SPECT) imaging. However, CT and MR imaging are the most widely used techniques, because of their widespread availability and their ability to produce high-resolution images of normal anatomic structures and pathologies [ 20 ].
1.1.1. Magnetic Resource Imaging
Magnetic resonance imaging (MRI) of a brain generates several 3-dimensional image data that comprise the three anatomical views of a brain (axial, sagittal, and coronal) at different depths of a brain. Depending on the strength of the magnetic field and the sampling protocols, the image quality, slice thickness, and inter-slice gap vary [ 21 , 22 ]. During MR imaging, a patient lay in a strong magnetic field, almost 10,000 times stronger than the earth’s magnetic field, that forces the protons in the water molecule of the body to align in either a parallel (low energy) or anti-parallel (high energy) orientation with the magnetic field. Then, a radiofrequency pulse is introduced that forces the spinning protons to move out of the equilibrium state. When a radiofrequency pulse pauses, the protons return to an equilibrium state and produce a sinusoidal signal at a frequency dependent on the local magnetic field. Finally, a radio antenna within the scanner detects the sinusoidal signal and creates the image [ 22 , 23 ]. The amount of signal produced by specific tissue types is determined by their number of mobile hydrogen protons, the speed at which they are moving, the time needed for the protons within the tissue to return to their original state of magnetization (T1), and the time required for the protons perturbed into coherent oscillation by the radiofrequency pulse to lose their coherence (T2) relaxation times. As T1 (spin-lattice, also known as longitudinal relaxation) and T2 (spin-spin, also known as traversal relaxation) times are time-dependent, the timing of the radio frequency pulse and the reading of the radiated RF energy change the appearance of the image. In addition, the repetition time (TR) describes the time between successive applications of RF pulse sequences, and the echo time (TE) tells the delay before the RF energy radiated by the tissue in question is measured. The variation of T1 and T2 relaxation times between tissues gives image contrast on T1- and T2-weighted (T1-w and T2-w) images. The T1-w sequence is characterized by short TR and short TE while the T2-w sequence is characterized by long TR and short TE. Tissues with shorter T1 (for example, white matter) appear brighter when compared to tissues with a longer T1 (for example, gray matter) in magnetic resonance images. The other intermediate sequence that adopts long TR from T2-w and short TE from T1-w is a proton density-weighted (PD-w). In PD-w, the number of protons per unit volume in tissues is the main factor in determining the formation of image [ 23 , 24 ].
In the current neuroimaging techniques different MRI brain scan procedures can be performed, these include, the conventional structural MRI, functional MRI, diffusion-weighted imaging (DWI), and diffusion tensor imaging (DTI) [ 10 ]. In structural MRI procedure which mainly differentiates healthy and abnormal brain tissues based on their water molecule content is the most commonly employed standard imaging technique. This procedure helps to visualize healthy brain tissues and to map gross brain anatomy, tumoral vascularity, calcification, and radiation-induced micro hemorrhage [ 10 , 11 ]. The structural sequences include T1-w, T2-w, FLAIR, and contrast-enhanced T1-w [ 10 ]. The functional MRI (fMRI) on the other hand is used to capture the neural activity inside a brain through the ratio of oxygenated to the deoxygenated level of blood in the neighboring vasculature while performing a cognitive or motor task. The fMRI is used to localize eloquent cortex and differentiate between tumor grades [ 10 ]. The DWI captures the random motion of water molecules in a brain and it is used to characterize a tumor through identification of its cellularity and hypoxia, peritumoral edema, the integrity of WM tracts, and to differentiate between posterior fossa tumors [ 10 , 25 ]. Whereas, diffusion tensor imaging (DTI) is used to analyze the 3D diffusion direction, also known as diffusion tensor, of the water molecule. The DTI helps to determine local effects of the tumor on white matter tract integrity including tract displacement, the existence of vasogenic edema, tumor infiltration, and tract destruction [ 26 ].
1.1.2. Computed Tomography Imaging
A computed tomography (CT) scan was used in neuroimaging to help understand the functional and structural status of clinically significant signs of diseases. However, it provides less information than an MRI in brain tumor diagnosis. For instance, CT is inferior to MRI in the characterization of soft tissues like a brain and its use of ionizing radiation. However, a computed tomography (CT) scan can provide more detailed images of the bone structures near a brain tumor, such as the skull or spine. A CT scan may also be used to diagnose a brain tumor if the patient has implants like a pacemaker and when an MRI is not available. Currently, a CT is commonly used in the diagnosis of diseases like acute hemorrhage Parkinson’s, head trauma, and in determining age [ 27 , 28 ]. Therefore, in this survey work, brain tumor segmentation and classification techniques that use the brain scan image of MRI are only explored.
The remaining part of the paper is organized as follows, Section 2 illustrates related works to this survey work and shows their strengths and limitations. In Section 3 , the literature search strategy, including the chronological span, journal databases, the keywords used for search, and the inclusion and exclusion criteria, is presented. In Section 4 , the commonly used model performance metrics in evaluating the performance of brain tumor segmentation and classification algorithms are highlighted. In Section 5 , different region growing, conventional shallow supervised machine learning, and deep learning-based brain tumor segmentation techniques are discussed. Furthermore, the reported performances are presented. The techniques used in conventional machine learning-based brain tumor classification and their classification performance are elaborated in Section 6 . In addition, different deep learning models based brain tumor classification techniques with their reported performance are presented. Finally, the paper presents a discussion on Section 7 and a conclusion in Section 8 .
2. Related Works
The quest to find a better autonomous brain tumor segmentation and classification technique that can aid physicians in brain tumor diagnosis have been an active research area. As a result, several survey works have been completed to foster the research in the field and recap techniques used in brain tumor segmentation and classification. In Table 1 , only some of the recent pieces of literature that are related to our survey work are listed. Furthermore, their strengths and limitations are clearly discussed.
Survey literature on brain tumor segmentation and classification techniques.
Our work is tailored to provide a comprehensive survey of recently proposed different brain tumor segmentation and classification techniques, including region growing, shallow machine learning, and deep learning. The established work in this survey also covers technical aspects, such as the strengths and weaknesses of different approaches, together with their performance.
In this survey work, peer reviewed research papers from 2015 to 2021 that were published on Scopus and Web of Science indexed journals are surveyed to investigate the region growing, deep learning based brain tumor segmentation techniques, and machine learning and deep learning based brain tumor classification techniques. The databases that are extensively searched for this survey work were: (1) IEEE Xplore Digital Library, (2) Science Direct, (3) PubMed, (4) Google Scholar, and (5) MDPI. The search criterion includes (“Brain Tumor”) AND (“Region Growing”) AND (“Segmentation”) AND (“Deep Learning”) AND ("Machine Learning") AND ("Classification"). The methodology used for selecting literature is clearly shown in Algorithm algorithm1. In addition, the paper inclusion criteria (IC) and exclusion criteria (EC) is indicated on Table 2 .
Inclusion and exclusion criteria for paper selection.
4. Performance Measuring Metrics
Evaluating the segmentation and classification performance of a machine learning algorithm is an essential part of a research project. A machine learning model may give a satisfying result when evaluated using a metric, for instance, accuracy score but may give poor results when evaluated against other metrics such as precision or any other metric. Therefore, most of the time various evaluation metrics are applied to measure and compare the model performance.
In a segmentation task, true positive (TP) represents a pixel that is correctly predicted to belong to the given class according to the ground truth, whereas a true negative (TN) represents a pixel that is correctly identified as not belonging to the given class. On the other hand, a false positive (FP) is an outcome where the model incorrectly predicts a pixel not belonging to a given class. A false negative (FN) is an outcome where the model incorrectly predicts the pixel belonging to a given class. Similarly, for tumor classification task, TP represents a tumor class that is correctly predicted to belong to the given class according to the ground truth whereas a TN represents a tumor class that is correctly identified as not belonging to the given class. By the same token, false positive (FP) is an outcome where the model incorrectly predicts a tumor class not belonging to a given class. A false negative (FN) is an outcome where the model incorrectly predicts the class belonging to a given class. Therefore, keeping different performance metrics used in brain tumor segmentation and classification literature are listed as follows.
Accuracy (ACC) measures the ability of a model in correctly identifying all class or pixels, no matter if it is positive or negative.
Sensitivity (SEN) indicates the frequency of correctly predicted positive samples/pixels among all real positive/samples. It measures the models ability in identifying positive samples/pixels.
Specificity (SPE) is the proportion of actual negatives, which was predicted as the negative (or true negative). It tells the percentage of classes/pixels could not correctly identified.
Recall (RE) describes the completeness of the machine learning model’s positive predictions relative to the ground truth. It tells the percentage of classes/pixels annotated in our ground truth, are also included in model’s prediction.
Precision (PR) also known as positive predictive value (PPV) describes how often the model predicting correct class/pixel. It tells the the correct proportion of models predicted positives.
F1-Score is the most popular metric that combines both precision and recall. It represents harmonic mean of the two.
Intersection over union (IoU) also known as Jaccard index (JI) measures the percent overlap between the annotated ground truth mask and the model’s prediction output.
Dice similarity coefficient (DSC) measures the spatial overlap between the ground truth tumor region and the model segmented region. A zero DSC value indicates no spatial overlap between the ground truth tumor region and model annotated result whereas a value indicates a indicating complete overlap between the two.
Area under the curve (AUC) measure of the ability of a classifier to distinguish between classes and is used as a summary of the receiver characteristics curve and it is an area under true positive rate vs. false positive rate.
Similarity index (SI) refers to the similarity between the expert annotated ground truth and the model’s segmentation. It describes the similar identity between the input image and the detected tumor region.
5. Brain Tumor Segmentation Methods
Brain tumor imaging using techniques, such as MRI and CT, generate a significantly large number of images. Brain MRI scan of a single individual consists of several slices across the 3D anatomical view. Therefore, manual segmentation of brain tumors from magnetic resonance (MR) images is a challenging and time-consuming task. In addition, the artifacts introduced in the imaging process results in low-quality images that make the interpretation difficult. As a result, the manual brain MRI segment is susceptible for inter and intra observable variability. To alleviate these challenges and help radiologist, different automatic brain tumor segmentation techniques have been proposed in literature.
On these literature, authors have proposed an automated system for brain tumor segmentation techniques that provides objective, reproducible segmentation that are close to the manual results. These automated brain tumor segmentation can help to alleviate the difficulties associated with manually analyzing brain tumors. This will speed-up the brain image analysis process, improve diagnosis outcome, and make easy the follow-up of the disease through evaluating tumor progression [ 34 ].
In this section, among the proposed brain tumor segmentation techniques in the literature; region growing, machine learning, and deep learning based techniques will be surveyed to identify the experimental dataset, pre-processing, feature extraction, segmentation algorithm, and the reported performance.
5.1. Region-Based and Shallow Unsupervised Machine Learning Approach
One of the most commonly used segmentation techniques in automated image processing applications is region-based segmentation. Regions in an image are a group of connected pixels that satisfy certain homogeneity criteria, such as pixel intensity values, shape, and texture [ 35 ]. In a region-based segmentation the image is partitioned into dissimilar regions so that the desired region is located precisely [ 36 ]. The region-based segmentation takes into account the pixel values, such as gray level difference and variance, and spatial proximity of pixels, such as Euclidean distance and region compactness in grouping pixels together. In brain tumor segmentation, region growing, and clustering algorithms are the most commonly used region based segmentation technique.
Clustering-based segmentation is one of the powerful region based segmentation techniques where an image is partitioned into a number of disjoint groups. In clustering based segmentation pixels with high similarity categorized in a given region whereas dissimilar pixels categorized into different regions [ 37 ]. Clustering techniques, which are an unsupervised learning method, have been widely investigated in medical image segmentation. However, in this survey work some of the most popular clustering methods, such as k-means and its varieties [ 38 , 39 , 40 , 41 , 42 , 43 , 44 ], fuzzy c-means [ 38 , 39 , 41 , 45 ], subtractive clustering (SC), and hybrid techniques [ 46 , 47 , 48 ].
K-means clustering is an unsupervised machine learning algorithm and it is commonly used to segment a region of interest from the remaining part of an image. K-means has been extensively tested in brain tumor segmentation and has shown acceptable accuracy [ 48 ]. The minimal computational requirement [ 37 , 48 ], simplicity to implement on large dataset [ 49 ], adaptation to new examples, and guaranteed convergence are some of the advantages that makes K-means popular segmentation algorithm. However, k-means suffers with incomplete delineation of the tumor region [ 49 ], selection of the initial centroid is not optimum [ 37 , 43 ], and it is sensitive to outliers [ 48 , 50 ]. Due to these limitations a number of solutions have been proposed, including, evenly spreading the initial cluster centers (k-means++), hybridizing k-means with other clustering techniques [ 49 ], adaptively initializing cluster centers, such as adaptive k-means [ 43 ], modified adaptive k-means (MAKM), and histogram based k-means.
Fuzzy c-means works by assigning membership values to each of the pixels in an image corresponding to the centers of the clusters depending on a certain similarity criteria [ 51 ]. In fuzzy c-means (FCM) clustering objects can belong to more than one cluster based on its degree of membership. Therefore, in such a type of soft clustering technique, image pixels can occupy multiple clusters. As a result, compared to hard-clustering techniques such as k-means, FCM performs better on relatively noise free images. However, in medical images such as brain MRI that can be easily affected by unknown noises, the FCM performance is severely affected [ 52 ]. A number of researches have been performed to improve the limitation of FCM [ 53 , 54 , 55 , 56 ].
In region growing brain tumor segmentation, tissues including tumorous regions are partitioned based on certain similarity criterion, such as homogeneity, texture, sharpness, and gray levels. The technique starts by selecting an initial seed based on predefined methods. Then, the neighboring pixels are added progressively to the seed pixel [ 57 ]. The region growing based segmentation can properly segment regions with similar properties and spatially separated regions. However, it is sensitive to noise and influenced by the similarity criterion [ 57 ]. Therefore, it may end up with disconnected regions and results in a hole in the segmented region. Furthermore, finding a good initial seed is not an easy task [ 57 ]. Region growing and conventional unsupervised machine learning based brain tumor segmentation techniques proposed in literature are summarized in Table 3 . The table indicates the brain MRI dataset used in the experiment, the centroid initialization techniques, the objective function, and the segmentation performance.
Region growing and shallow unsupervised machine learning based brain tumor segmentation.
1 Darwinian Particle Swarm Optimization, 2 Discrete Wavelet Transform.
5.2. Supervised Shallow Machine Learning Based Approach
Supervised machine learning-based brain tumor segmentation approaches transformed the image segmentation problem into a tumorous pixel classification problem. The input vector for these supervised learning models consisted of different extracted features, and the output is a vector of desired classes for segmentation. In brain tumor segmentation, where tumor regions are often scattered all over the image, pixel classification rather than classical segmentation methods are often preferable [ 65 ]. Therefore, the traditional supervised machine learning algorithms have been used in the segmentation of a brain tumor from a head MRI scan [ 66 , 67 , 68 , 69 , 70 , 71 , 72 , 73 , 74 , 75 , 76 ].
In this section, as shown in Table 4 , most relevant literature on brain tumor segmentation using traditional machine learning algorithms, such as support vector machine (SVM), artificial neural network (ANN), random forest (RF) are surveyed to identify data used, the pre-processing, feature extraction techniques, the classifier model, and whether or not post-processing is implemented.
Summary of a shallow machine learning based segmentation.
1 Simple Linear Iterative Clustering, 2 Concatenated and Connected Random Forest, 3 Multiscale Patch Driven Active Contour, 4 Random Decision Forest.
5.3. Deep Learning-Based Approach
Deep learning methodologies produce automatic features that avoid or minimize the need for handcrafted features. In the deep learning-based brain tumor segmentation approach, the general strategy is to pass an image through the pipeline of deep learning building blocks and input image segmentation is performed depending on the deep features. In literature, there are a variety of deep learning techniques proposed for segmenting brain tumors. Some of such blocks contain deep convolutional neural networks (DCNNs), convolutional neural network (CNN), recurrent neural networks (RNNs), long short-term memory (LSTM), deep neural networks (DNNs), deep autoencoders (AEs), and generative adversarial networks (GANs). In this section, literature in terms of these building blocks, the dataset used, and the reported performance are presented as shown in Table 5 .
Summary of deep learning based brain tumor segmentation techniques.
1 Heterogeneous CNN + Conditional Random Fields-Recurrent Regression based Neural Network, 2 Deep Residual Dilate Network with Middle Supervision, 3 Fully Convolutional Neural Network, 4 OCcipito Module, 5 Atrous-Convolution Feature Pyramid.
6. Brain Tumor Classification Methods
Based on the WHO’s classification of central nervous system (CNS) tumors, there are more than 150 types of CNS tumors that are mainly categorized into primary and metastatic (secondary) tumors [ 99 ]. The primary tumors originate from the brain or the immediate surrounding tissues. Whereas, metastatic tumors arise from other body parts and migrate to the brain through the bloodstream. Metastatic tumors are considered cancerous or malignant, while primary tumors can be benign or malignant.
A biopsy is the existing gold standard procedure in brain tumor classification. However, it usually requires definitive brain surgery to take a sample [ 100 , 101 ]. On the other hand, an automated brain tumor classification from an MRI is non-invasive so that it avoids tumor sample taking procedure and it is safer. In addition, the machine learning-based brain tumor classification from an MRI scan can improve the diagnosis and treatment planning [ 101 ]. As a result, an automatic brain tumor classification from MRI images using machine or deep learning techniques is an active research area, and promising results have been achieved [ 100 , 102 , 103 , 104 , 105 , 106 ].
6.1. Conventional Machine Learning Based Approach
Machine learning is a paradigm where a machine is given a task where its performance improves with experience. Machine learning techniques are commonly grouped into three major types: supervised, unsupervised, and reinforcement learning [ 107 ]. Supervised learning is based on training a data sample from the data source with correct classification already assigned by domain experts, whereas, in unsupervised learning, the algorithm finds hidden patterns from the unlabeled data. On the other hand, reinforcement learning is carried out by making a sequence of decisions using reward signals. Therefore, the algorithm learns through receiving either rewards or penalties for the actions it performs [ 107 ]. Machine learning has been used in the classification of brain tumors from MRI images, and promising classification performance has been reported [ 108 , 109 , 110 , 111 , 112 , 113 , 114 , 115 ].
The traditional machine learning-based brain tumor classification techniques often consist of preprocessing, segmentation, feature extraction, and classification stages.
6.1.1. Pre-processing
Brain MRI scans are significantly affected by different types of noises, including salt and pepper, Gaussian, Rician, and speckle noise [ 116 , 117 , 118 ]. These noises impose challenges in machine learning-based applications [ 117 , 119 ]. Therefore, obtaining high-quality image denoising is one of the important tasks in the pre-processing stage. Each method used in MRI denoising has its advantages and disadvantages. Several methods have been developed for reducing noises based on statistical property and frequency spectrum distribution [ 119 ]. In addition to denoising, tasks such as removing tags, smoothing the foreground region, intensity inhomogeneity correction, maintaining relevant edges, resizing, cropping, and skull stripping are part of pre-processing [ 110 , 111 , 112 ].
6.1.2. Region of Interest (ROI) Detection
In an MRI brain scan, the segmentation task labels each voxel in an MRI image to specify its tissue type and anatomical structure [ 119 ]. The objective of ROI detection in tumor classification is to locate the tumor region from an MRI scan, improve the visualization, and allow quantitative measurements of image structures in the feature extraction stage [ 108 , 112 ]. Brain tumor segmentation can be performed in three different ways, namely, manual segmentation, semi-automatic segmentation, and fully automatic segmentation [ 119 ]. The autonomous brain segmentation techniques have been briefly discussed in Section 5 .
6.1.3. Feature Extraction
The feature extraction techniques are mathematical models based on various image properties. The different types of features include texture, brightness, contrast, shape, Gabor transforms, gray-level co-occurrence matrix (GLCM), and wavelet-based features [ 115 , 120 ], histogram of local binary patterns (LBP) [ 121 ]. On the other hand, recently, deep features that are obtained from deep neural networks such as CNN have been used as input to SVM classifier to classify brain tumors [ 122 ]. In brain tumor classification, it is customary to fuse several features from different extraction models to improve the discrimination power of the machine learning model [ 123 ]. Furthermore, feature selection is applied for dimensionality reduction.
6.1.4. Classification
Different classification techniques have been proposed by many authors for identifying tumor types from brain images. Different authors have classified tumor into a variety of ways, for instance meningioma, glioma, and pituitary [ 109 , 121 , 122 , 124 , 125 ]; astrocytoma, glioblastoma, and oligodendrogliamo [ 112 ]; glioma tumor grades (I–IV) [ 113 ]; benign and malignant stages(I–IV) [ 126 , 127 , 128 , 129 ]; diffuse midline glioma, medulloblastoma, pilocytic astrocytoma, and ependymoma [ 102 ]; multifocal, multicentric, and gliomatosis [ 130 ]; ependymoma and pilocytic astrocytoma [ 120 ].
In brain tumor classification, the most commonly used classifiers are neural network [ 108 , 109 , 110 , 111 , 131 ], support vector machines (SVM) [ 108 , 115 , 124 , 127 , 128 , 129 , 130 , 132 , 133 ], K-nearest neighbor (KNN) [ 112 , 121 , 130 , 134 ], Adaboost [ 126 ], and hybrid models [ 113 , 135 , 136 ]. The neural network was implemented using different architectures, such as feedforward neural network [ 110 , 125 ], multilayer perceptron neural network [ 109 , 137 ], and probabilistic neural network (PNN) [ 111 , 131 ]. Support vector machine (SVM) was commonly implemented using three kernels, linear, homogeneous polynomial, and Gaussian radial basis function (RBF) [ 108 , 115 ]. In the KNNclassifier, the testing feature vector is classified by finding the k-nearest training neighbor, that is, the classifier does not use any model to match and is only based on memory. However, KNN uses different measurements such as euclidean distance, city block, cosine, and correlation to find the nearest distance between the testing and training class feature vectors [ 134 ].
A summary of recent shallow machine learning-based brain tumor classification techniques is given on Table 6 .
Summary of conventional ML based brain tumor classification techniques.
1 Principal Component Analysis, 2 Particle Swarm Optimization, 3 Regularized Extreme Learning Machine.
6.2. Deep Learning Approach
Even though promising progress has been made in classifying brain tumors into their respective types from an MRI brain scan using shallow supervised machine learning algorithms, there are still challenges in classifying brain tumors from an MRI scan. These challenges are mainly due to the ROI detection, and extracting descriptive information using traditionally handcrafted feature extraction techniques is not efficient [ 122 ]. This inefficiency mainly arises due to the complex structure of brain anatomy and the high-density nature of the brain.
Unlike shallow machine learning algorithms, deep learning is based on learning data representations and hierarchical feature learning. In deep learning-based brain tumor classification, the deep learning models discover the descriptive information that optimally represents different brain tumors. This nature of deep learning transforms the brain tumor classification from handcrafted feature-driven into data-driven problem [ 103 ]. Among the deep learning models, a convolutional neural network (CNN) is widely used in brain tumor classification tasks, and a substantial result has been achieved[ 100 ].
In the reviewed literature, there are differences in the techniques used for the classification of brain tumors. The difference encompasses: (i) the dataset used for classification including tumor types, (ii) the implemented pre-processing and data augmentation techniques, (iii) whether or not the ROI segmentation was used as a prior step in the classification, (iv) whether a pre-trained or custom-designed deep learning model is used.
For instance, Badža and Barjaktarović[ 100 ] used publicly available contrast-enhanced T1-weighted brain tumor MRI scans [ 138 ]. The dataset contains meningioma, glioma, and pituitary brain tumor types scanned along with the three anatomical views, i.e., axial, sagittal, and coronal. The images were preprocessed using techniques, such as normalization and resizing. In addition, images in the dataset are augmented with 90 o rotation and vertical flipping to increase the training dataset. Furthermore, they used a custom-designed CNN model trained with Adam optimizer with a mini-batch size of 16 and tested with 10—fold cross-validation. The weights of the convolution layers are initialized using a Glorot initializer. The model performance was measure using sensitivity, specificity, accuracy, precision, recall, and F1-score. The sensitivity for meningioma, glioma, and pituitary is 89.8%, 96.2%, and 98.4%, respectively. The specificity of the model for meningioma, glioma, and pituitary is 90.2%, 95.5%, and 97.7%, respectively. Furthermore, the models’ overall accuracy, average precision, average recall, and F1-score are 95.4%, 94.81%, 95.07%, and 94.94%, respectively. The summary of this and other literature is presented on Table 7 .
Summary of deep learning based brain tumor classification techniques.
1 Convolutional Neural Network based on Complex Networks, 2 Confidence Interval, 3 Automated Machine Learning, 4 Matthew’s Correlation Coefficient, 5 Visual Geometry Group, 6 Deep Dense Inception Residual Network, 7 High Grade Glioma, 8 Low Grade Glioma.
7. Discussion
This paper presented a thorough survey of techniques used in brain tumor segmentation and classification. The survey encompasses several traditional machine learning and deep learning-based methods with their quantitative performance. The conventional image segmentation techniques, that is, region growing and unsupervised machine learning used in brain tumor segmentation are presented in Table 3 . The region growing with all other conventional image processing segmentation techniques is the earliest approach applied in brain tumor segmentation [ 161 ]. It is mainly affected by noises, poor image quality, and initial seed point. To overcome these challenges, an automatic seed point selection by optimization techniques and artificial intelligence-based seed point selection has been proposed [ 162 ]. In addition, it has a limitation in segmenting tumors that appear scattered across the brain. In the second generation segmentation techniques which are based on shallow unsupervised machine learning, such as fuzzy c-means and k-means grouping of pixels into more than one class has been achieved. However, these methods are also highly sensitive to noise. Therefore, through incorporating additional information and adaptively selecting the centroid, the segmentation performance of medical images can be improved [ 6 ]. In addition, the inherent ambiguous boundaries between normal tissues and brain tumors pose a significant challenge for conventional and clustering segmentation techniques. Therefore, to address this challenge, pixel-level classification-based segmentation techniques using traditional supervised machine learning have been proposed [ 70 ]. These methods are often accompanied by feature engineering, where the tumor descriptive pieces of information are extracted to train the model. Furthermore, the supervised machine learning segmentation output is further improved through post-processing [ 71 , 76 ].
Nowadays, conventional image processing and shallow machine learning-based brain tumor segmentation techniques are becoming obsolete due to the advent of deep learning-based techniques. The deep learning-based approach performs an end-to-end tumor segmentation by passing an MRI image through the pipeline of its building blocks. These models often extract tumor descriptive information automatically and avoid the need for handcrafted features. However, the need for a large dataset to train the models and the difficulty in interpreting the models hinders their usage in medical fields [ 163 ]. In terms of segmentation performance, it is evident from Table 4 and Table 5 that the deep learning-based and supervised shallow machine learning-based with post-processing has comparable performances. Asummary of the number of brain tumor segmentation techniques surveyed in this is given on Figure 1 .
Number of brain tumor segmentation methods.
Aside from segmentation of brain tumor region from head MRI scan, classification of tumor into their respective histological type has great importance in diagnosis and treatment planning which actually requires biopsy procedure in today’s medical practice [ 158 ]. Several methods which encompass shallow machine learning and deep learning have been proposed for brain tumor classification. The conventional shallow machine learning algorithms often consist of preprocessing, ROI detection, and feature extraction. However, due to the inherent noise sensitivity of MRI image acquisition, variations in the shape, size, location, and contrast of tumor tissue cells, extracting descriptive information is a challenging task. Therefore, nowadays, deep learning techniques are becoming the state-of-the-art approach to classify different types of brain tumors, such as astrocytoma, glioma, meningioma, and pituitary. Several brain tumor classifications have been discussed in this survey, and a summary of the number of brain tumor classification techniques surveyed in this paper are given on Figure 2 .
Number of brain tumor classification methods.
Several brain tumor datasets that are collected by researchers datasets and those that are available on repositories were used in the training and testing of brain tumor classification models. The publicly available dataset provided by J. Cheng et al. [ 138 ], which contains meningioma, glioma, and pituitary tumor in T1-WC MRI-images is one of the most commonly used datasets in the training and testing classifier models. Using this dataset, Gumaei, A. et al. [ 125 ] has achieved a classification accuracy of 94.23% using a regularized extreme learning machine, while the Kokkalla, S. et al. [ 153 ] have reported a classification accuracy of 99.69% using custom modified deep-dense inception residual network (DDIRNet). These results indicate that the deep learning-based model outweighs the shallow machine learning-based techniques for this particular dataset.
Challenges in Automatic Brain Tumor Segmentation and Classification
The development of autonomous brain tumor segmentation and classification models using MRI images is still a challenging task. The challenges are due to several constraints including the effect of different types of noises embedded in the brain MRI images [ 116 , 117 , 118 ], motion and metal artifacts during image acquisition [ 164 ], low-resolution MRI images [ 165 ], and lack of deep learning models interpretability and transparency [ 166 , 167 ].
One of the most common challenges in machine learning-based brain tumor segmentation and classification is the noisiness of an MRI image. Therefore, noise estimation and denoising MRI images is a crucial pre-processing task for improving the accuracy of brain tumor segmentation and classification models. Therefore, several techniques have been proposed for denoising MRI images, such as modified iterative grouping median filter [ 118 ], Wiener filter and wavelet transform [ 168 ], non-local means [ 169 ], and deep learning-based approaches [ 170 , 171 ]. However, a robust denoising technique for MRI images is still challenging and the pursuit to obtain an efficient denoising technique has been an active research area [ 170 ]. Similarly, motion, metal, and other artifacts are also a source of challenge to the robustness of machine learning-based brain tumor segmentation and classification. Recently, deep learning-based solutions for minimizing the effects of these artifacts have been proposed [ 164 , 172 ]. MRI provides a high fidelity brain scan image compared to other imaging techniques. However, post-acquisition image processing techniques, including deep learning-based methods have been used to increase the resolution of MR images so that the efficiency of autonomous brain tumor segmentation and classification models improved[ 165 , 173 ]. The other major challenge is the lack of deep models’ interpretability, and often they are perceived as black-box. As a result, attaining any evidence regarding the process they perform is difficult. However, the transparency and interpretability of deep learning techniques are crucial for the complete integration into medical diagnosis [ 166 ].
8. Conclusions
Automating the brain tumor segmentation and classification task has tremendous benefits in improving the diagnosis, treatment planning, and follow-up of patients. Through applying various techniques, including conventional image processing, shallow machine learning, and deep learning techniques, undeniable progress have been achieved in automating brain tumor segmentation and classification tasks. However, building a fully autonomous system that can be used on clinical floors is still a challenging task.
Compared to region-growing and shallow machine learning algorithms, automating the brain tumor segmentation and classification using deep learning techniques have huge benefits. This is mainly due to the powerful feature learning ability of deep learning techniques. In addition, as can be shown in Figure 1 and Figure 2 , deep learning-based brain tumor segmentation and classification techniques are becoming the most active research area. In this paper, a comprehensive survey on region growing, shallow machine learning, and deep learning-based brain tumor segmentation and classification methods are presented. These methods are structurally categorized and summarized to give an insight to the reader of the dataset used, pre-processing, feature extraction, segmentation, classification, post-processing, and the reported model performances in the literature. Furthermore, the pros and cons of the methods and the model evaluation metrics have been discussed.
Author Contributions
Conceptualization, E.S.B.; Methodology, E.S.B.; Validation, Y.M.A., F.S., T.G.D.; Writing—original draft preparation, E.S.B.; Writing—review and editing, E.S.B., Y.M.A., F.S., T.G.D. All authors have read and agreed to the published version of the manuscript.
This research received no external funding.
Institutional Review Board Statement
Informed consent statement, data availability statement, conflicts of interest.
The authors declare no conflict of interest.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
International Conference on Bio-Inspired Computing: Theories and Applications
BIC-TA 2016: Bio-inspired Computing – Theories and Applications pp 314–335 Cite as
Image Segmentation Using Membrane Computing: A Literature Survey
- Rafaa I. Yahya 14 , 15 , 16 ,
- Siti Mariyam Shamsuddin 14 , 16 ,
- Salah I. Yahya 16 , 17 ,
- Shafatnnur Hasan 14 , 16 ,
- Bisan Al-Salibi 16 , 18 &
- Ghada Al-Khafaji 16 , 19
- Conference paper
- First Online: 08 January 2017
1035 Accesses
3 Citations
Part of the Communications in Computer and Information Science book series (CCIS,volume 681)
Membrane computing, a recent branch of natural computing, has been gaining momentum attention in the last few decades due to its massive parallelism and efficient computation. Many researchers in the field of membrane computing have proposed sophisticated techniques inspired by cell biology for computer science applications, especially when they considered cell organization in tissues, organs, and most recently, from the organization of neurons. The interdisciplinary applications of membrane computing include, but not limited to computer science, biology, biomedicine, bioinformatics and several other fields such as mathematics, artificial intelligence, automation, economics, to name but a few. Their applications are pertaining to computer graphics, approximate optimization, cryptography, parallel computing and image processing. Hence, in this paper we present an up to date comprehensive literature review pertaining to the application of membrane computing in the area of digital image analysis, especially image segmentation, comprehensively and systematically. We thoroughly investigate the recent advancement in the field of image segmentation using membrane system. Furthermore, we highlight the merits and demerits of various software tools and methods. Finally, we suggest some intuitive future directions in light of the current limitations.
- Membrane computing
- Image segmentation
- Tissue-like P system
This is a preview of subscription content, log in via an institution .
Buying options
- Available as PDF
- Read on any device
- Instant download
- Own it forever
- Available as EPUB and PDF
- Compact, lightweight edition
- Dispatched in 3 to 5 business days
- Free shipping worldwide - see info
Tax calculation will be finalised at checkout
Purchases are for personal use only
Păun, G.: Computing with membranes. J. Comput. Syst. Sci. 61 (1), 108–143 (2000). doi: 10.1006/jcss.1999.1693
Article MATH MathSciNet Google Scholar
Păun, G., Rozenberg, G., Salomaa, A.: The Oxford Handbook of Membrane Computing. Oxford University Press Inc., New York (2010)
Book MATH Google Scholar
Zandron, C., Ferretti, C., Mauri, G.: Solving NP-complete problems using P systems with active membranes. In: Antoniou, I., Calude, C.S., Dinneen, M.J. (eds.) Unconventional Moldels of Computation, pp. 289–301. Springer, Heidelberg (2012). doi: 10.1007/978-1-4471-0313-4_21
Google Scholar
Păun, G.: Introduction: membrane computing what it is and what it is not. In: Păun, G. (ed.) Membrane Computing, pp. 1–6. Springer, Heidelberg (2002). doi: 10.1007/978-3-642-56196-2_1
Chapter Google Scholar
Alsalibi, B., Venkat, I., Subramanian, K., Lutfi, S.L., Wilde, P.D.: The impact of bio-inspired approaches toward the advancement of face recognition. ACM Comput. Surv. (CSUR). 48 (1), 5 (2015). doi: 10.1145/2791121
Article Google Scholar
Păun, G.: Membrane computing: power, efficiency, applications. In: Cooper, S.B., Löwe, B., Torenvliet, L. (eds.) CiE 2005. LNCS, vol. 3526, pp. 396–407. Springer, Heidelberg (2005). doi: 10.1007/11494645_49
Păun, G.: Membrane computing: an introduction. Springer, Heidelberg (2002). doi: 10.1007/978-3-642-56196-2
Yahya, R.I., Hasan, S., George, L.E., Alsalibi, B.: Membrane computing for 2D image segmentation. Int. J. Adv. Soft Comput. Appl. 7 (1), 35–50 (2015)
Zhang, X., Jiang, Y., Pan, L.: Small universal spiking neural P systems with exhaustive use of rules. In: 3rd International Conference on Bio-Inspired Computing: Theories and Applications BICTA 2008, IEEE (2008). doi: 10.1109/BICTA.2008.4656713
Pan, L., Păun, G.: Spiking neural P systems: an improved normal form. Theor. Comput. Sci. 411 (6), 906–918 (2010). doi: 10.1016/j.tcs.2009.11.010
Pan, L., Zeng, X.: Small universal spiking neural P systems working in exhaustive mode. IEEE Trans. Nanobiosci. 10 (2), 99–105 (2011). doi: 10.1109/TNB.2011.2160281
Păun, A.: On P systems with active membranes. In: Antoniou, I., Calude, C.S., Dinneen, M.J. (eds.) Unconventional Models of Computation, UMC’2K, pp. 187–201. Springer, Heidelberg (2011). doi: 10.1007/978-1-4471-0313-4_15
Niu, Y., Pan, L., Pereez-Jimenez, M.J., Font, M.R.: A tissue P systems based uniform solution to tripartite matching problem. Fundamenta Informaticae 109 (2), 179–188 (2011). doi: 10.3233/FI-2011-503
MATH MathSciNet Google Scholar
Pan, L., Păun, G., Pereez-Jimenez, M.J.: Spiking neural P systems with neuron division and budding. Sci. China Inf. Sci. 54 (8), 1596–1607 (2011). doi: 10.1007/s11432-011-4303-y
Pan, L., Ishdorj, T.-O.: P systems with active membranes and separation rules. J. UCS. 10 (5), 630–649 (2004). doi: 10.3217/jucs-010-05-0630
MathSciNet Google Scholar
Păun, G., Suzuki, Y., Tanaka, H., Yokomori, T.: On the power of membrane division in P systems. Theor. Comput. Sci. 324 (1), 61–85 (2004). doi: 10.1016/j.tcs.2004.03.053
Porreca, A.E., Leporati, A., Mauri, G., Zandron, C.: P systems with active membranes: trading time for space. Nat. Comput. 10 (1), 167–182 (2011). doi: 10.1007/s11047-010-9189-x . Springer
Alhazov, A., Mart-Vide, C., Pan, L.: Solving graph problems by P systems with restricted elementary active membranes. In: Jonoska, N., Păun, G., Rozenberg, G. (eds.) Aspects of Molecular Computing, pp. 1–22. Springer, Heidelberg (2004). doi: 10.1007/978-3-540-24635-0_1
Díaz-Pernil, D., Gutiérrez-Naranjo, M.A., Pérez-Jiménez, M.J., Riscos-Núñez, A.: Solving subset sum in linear time by using tissue p systems with cell division. In: Mira, J., Álvarez, J.R. (eds.) IWINAC 2007. LNCS, vol. 4527, pp. 170–179. Springer, Heidelberg (2007). doi: 10.1007/978-3-540-73053-8_17
Díaz-Pernil, D., Gutirez-Naranjo, M.A., Pez-Jimez, M.J., Riscos-Nez, A.: A uniform family of tissue P systems with cell division solving 3-COL in a linear time. Theor. Comput. Sci. 404 (1–2), 76–87 (2008). doi: 10.1016/j.tcs.2008.04.005
Article MathSciNet Google Scholar
Díaz-Pernil, D., Pereez-Jimenez, M.J., Riscos-Nez, A., Romero-Jimez, A.: Computational efficiency of cellular division in tissue-like membrane systems. Rom. J. Inf. Sci. Technol. 11 (3), 229–241 (2008)
Păun, G.: P systems with active membranes: attacking NP-complete problems. J. Automata Lang. Comb. 6 (1), 75–90 (2001)
Guerrero, G.D., Cecilia, J.M., Garc, J., Martinez-del-Amor, M., Pérez-Hurtado, I., Pérez-Jimenez, M.J.: Analysis of P systems simulation on CUDA. XX Jornadas de Paralelismo 2009 , 289–294 (2009)
Cecilia, J.M., Garc, J.M., Guerrero, G.D., Martinez-del-Amor, M.A., Pérez-Hurtado, I., Pérez-Jimenez, M.J.: Simulation of P systems with active membranes on CUDA. Briefings Bioinform. 11 (3), 313–322 (2010). doi: 10.1109/HiBi.2009.13
Cabarle, F.G., Adorna, H., Martínez-del-Amor, M.A., Pérez-Jiménez, M.J.: Spiking neural P system simulations on a high performance GPU platform. In: Xiang, Y., Cuzzocrea, A., Hobbs, M., Zhou, W. (eds.) ICA3PP 2011. LNCS, vol. 7017, pp. 99–108. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-24669-2_10
Cabarle, F.G.C., Adorna, H., Martínez, M.A.: A spiking neural P system simulator based on CUDA. In: Gheorghe, M., Păun, G., Rozenberg, G., Salomaa, A., Verlan, S. (eds.) CMC 2011. LNCS, vol. 7184, pp. 87–103. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-28024-5_8
Cecilia, J.M., Garca, J.M., Guerrero, G.D., Martez-del-Amor, M.A.: The GPU on the simulation of cellular computing models. Soft Comput. 16 (2), 231–246 (2012). doi: 10.1007/s00500-011-0716-1
Gelenbe, E.: Fundamental Concepts in Computer Science. Imperial College Press, London (2009)
Mart-Vide, C., Păun, G., Pazos, J., Rodruez-Pat, A.: Tissue P systems. Theor. Comput. Sci. 296 (2), 295–326 (2003). doi: 10.1016/S0304-3975(02)00659-X
Ionescu, M., Păun, G., Yokomori, T.: Spiking neural P systems. Fundamenta Informaticae 71 (2), 279–308 (2006)
Ibarra, O.H., Păun, G.: Membrane computing: a general view. Ann. Eur. Acad. Sci., 83–101 (2006). EAS Publishing House, Liege
Ceterchi, R., Gramatovici, R., Jonoska, N., Subramanian, K.: Tissue-like P systems with active membranes for picture generation. Fundamenta Informaticae 56 (4), 311–328 (2002)
Chao, J., Nakayama, J.: Cubical singular simplex model for 3D objects and fast computation of homology groups. In: Proceedings of the 13th International Conference on Pattern Recognition. IEEE (1996). doi: 10.1109/ICPR.1996.547259
Ceterchi, R., Mutyam, M., Păun, G., Subramanian, K.: Array-rewriting P systems. Nat. Comput. 2 (3), 229–249 (2003)
Peña-Cantillana, F., Díaz-Pernil, D., Berciano, A., Gutiérrez-Naranjo, M.A.: A parallel implementation of the thresholding problem by using tissue-like P systems. In: Real, P., Diaz-Pernil, D., Molina-Abril, H., Berciano, A., Kropatsch, W. (eds.) CAIP 2011. LNCS, vol. 6855, pp. 277–284. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-23678-5_32
Christinal, H.A., Dz-Pernil, D., Gutirez-Naranjo, M.A., Pez-Jimez, M.J.: Thresholding of 2D images with cell-like P systems. Rom. J. Inf. Sci. Technol. (ROMJIST) 13 (2), 131–140 (2010)
Díaz-Pernil, D., Christinal, H.A., Gutirez-Naranjo, M.A., Real, P.: Using membrane computing for effective homology. Appl. Algebra Eng. Commun. Comput. 23 (5–6), 233–249 (2012). doi: 10.1007/s00200-012-0176-6
Alsalibi, B., Venkat, I., Subramanian, K., Christinal, H.: A bio-inspired software for homology groups of 2D digital images. In: Asian Conference on Membrane Computing (ACMC), 2014 IEEE (2014). doi: 10.1109/ACMC.2014.7065800
Ardelean, I., Díaz-Pernil, D., Gutirez-Naranjo, M.A., Pena-Cantillana, F., Reina-Molina, R., Sarchizian, I.: Counting cells with tissue-like P systems. In: Proceedings of the Tenth Brainstorming Week on Membrane Computing, vol. 1, p. 03 (2012)
Zhang, G., Gheorghe, M., Li, Y.: A membrane algorithm with quantum-inspired subalgorithms and its application to image processing. Nat. Comput. 11 (4), 701–717 (2012). doi: 10.1007/s11047-012-9320-2
Peña-Cantillana, F., Berciano, A., Díaz-Pernil, D., Gutiérrez-Naranjo, M.A.: Parallel skeletonizing of digital images by using cellular automata. In: Ferri, M., Frosini, P., Landi, C., Cerri, A., Fabio, B. (eds.) CTIC 2012. LNCS, vol. 7309, pp. 39–48. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-30238-1_5
Díaz-Pernil, D., Pe-Cantillana, F., Gutirez-Naranjo, M.A.: A parallel algorithm for skeletonizing images by using spiking neural P systems. Neurocomputing 115 , 81–91 (2013). doi: 10.1016/j.neucom.2012.12.032
Reina-Molina, R., Díaz-Pernil, D., Gutirez-Naranjo, M.A.: Cell complexes and membrane computing for thinning 2D and 3D images. In: Proceedings of the Tenth Brainstorming Week on Membrane Computing, vol. 2, p. 03 (2012)
Berciano, A., Christinal, H., Venkat, I., Subramanian, K.: First steps for a corner detection using membrane computing. In: Asian Conference on Membrane Computing (ACMC), 2014 IEEE (2014). doi: 10.1109/ACMC.2014.7065805
Freixenet, J., Muñoz, X., Raba, D., Martí, J., Cufí, X.: Yet another survey on image segmentation: region and boundary information integration. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 408–422. Springer, Heidelberg (2002). doi: 10.1007/3-540-47977-5_27
Díaz-Pernil, D., Molina-Abril., H., Real, P., Gutirez-Naranjo, M.A.: A bio-inspired software for segmenting digital images. In: Bio-Inspired Computing: Theories and Applications (BIC-TA), 2010. IEEE (2010). doi: 10.1109/BICTA.2010.5645062
Păun, G.: Introduction to membrane computing. In: Ciobanu, G., Păun, G., Pérez-Jiménez, M.J. (eds.) Applications of Membrane Computting, pp. 1–42. Springer, Heidelberg (2006)
Nguyen, V., Kearney, D., Gioiosa, G.: An implementation of membrane computing using reconfigurable hardware. Comput. Inform. 27 (3+), 551–569 (2012)
Christinal, H.A., Díaz-Pernil, D., Jurado, P.R.: Segmentation in 2D and 3D image using tissue-like P system. In: Bayro-Corrochano, E., Eklundh, J.-O. (eds.) CIARP 2009. LNCS, vol. 5856, pp. 169–176. Springer, Heidelberg (2009). doi: 10.1007/978-3-642-10268-4_20
Christinal, H.A., Díaz-Pernil, D., Real, P.: P systems and computational algebraic topology. Math. Comput. Modell. 52 (11), 1982–1996 (2010). doi: 10.1016/j.mcm.2010.06.001
Reina-Molina, R., Carnero, J., Diaz-Pernil, D.: Image segmentation using tissue-like P systems with multiple auxiliary cells. Image-A 1 (3), 143–150 (2010)
Carnero, J., Díaz-Pernil, D., Molina-Abril, H., Real, P.: Image segmentation inspired by cellular models using hardware programming. In: 3rd International Workshop on Computational Topology in Image Context (2010)
Christinal, H.A., Díaz-Pernil, D., Real, P.: Region-based segmentation of 2D and 3D images with tissue-like P systems. Pattern Recogn. Lett. 32 (16), 2206–2212 (2011). doi: 10.1016/j.patrec.2011.05.004
Christinal, H.A., Díaz-Pernil, D., Jurado, P.R., Selvan, S.E.: Color segmentation of 2D images with thresholding. In: Mathew, J., Patra, P., Pradhan, D.K., Kuttyamma, A.J. (eds.) ICECCS 2012. CCIS, vol. 305, pp. 162–169. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-32112-2_20
Isawasan, P., Venkat, I., Subramanian, K., Khader, A., Osman, O., Christinal, H.: Region-based segmentation of hexagonal digital images using membrane computing. In: 2014 Asian Conference on Membrane Computing (ACMC). IEEE (2014). doi: 10.1109/ACMC.2014.7065806
Yahya, R.I., Shamsuddin, S.M., Hasan, S., Yahya, S.I.: Tissue-like P system for segmentation of 2D hexagonal images. ARO- Sci. J. Koya Univ. 4 (1), 35–42 (2016). doi: 10.14500/aro.10135
Song, T., Pan, Z., Wong, D.M., Wang, X.: Design of logic gates using spiking neural P systems with homogeneous neurons and astrocytes-like control. Inf. Sci. 372 , 380–391 (2016)
Díaz-Pernil, D., Gutirez-Naranjo, M.A., Molina-Abril, H., Real, P.: Designing a new software tool for digital imagery based on P systems. Nat. Comput. 11 (3), 381–386 (2012). doi: 10.1007/s11047-011-9287-4
Yang, Y., Peng, H., Jiang, Y., Huang, X., Zhang, J.: A region-based image segmentation method under P systems. J. Inf. Comput. Sci. 10 (10), 2943–2950 (2013)
Peng, H., Yang, Y., Zhang, J., Huang, X., Wang, J.: A region-based color image segmentation method based on P systems. Sci. Technol. 17 (1), 63–75 (2014)
Carnero, J., Christinal, H.A., Díaz-Pernil, D., Reina-Molina, R., Subathra, M.S.P.: Improved parallelization of an image segmentation bio-inspired algorithm. In: Babu, B.V., Nagar, A., Deep, K., Pant, M., Bansal, J.C., Ray, K., Gupta, U. (eds.) SocProS 2012. AISC, vol. 236, pp. 75–82. Springer, Heidelberg (2014). doi: 10.1007/978-81-322-1602-5_9
Christinal, H.A., Berciano, A., Díaz-Pernil, D., Gutiérrez-Naranjo, M.A.: Searching partially bounded regions with P systems. In: Pant, M., Deep, K., Nagar, A., Bansal, J.C. (eds.) SocProS 2013, Volume 1. AISC, vol. 258, pp. 45–54. Springer, Heidelberg (2014). doi: 10.1007/978-81-322-1771-8_5
El-Rewini, H., Abd-El-Barr, M.: Advanced Computer Architecture and Parallel Processing. Wiley, Hoboken (2005)
Kirk, D.B., Wen-mei, W.H.: Programming Massively Parallel Processors: A Hands-on Approach. Newnes, Oxford (2012)
Song, T., Liu, X., Zhao, Y., Zhang, X.: Spiking neural P systems with white hole neurons. IEEE Trans. Nanobiosci. (2016). doi: 10.1109/TNB.2016.2598879
Hamadani, N.: Automatic target cueing in IR imagery. Master’s thesis, WPAFB, Ohio (1981)
Wang, X., Song, T., Gong, F., Pan, Z.: On the computational power of spiking neural P systems with self-organization, Sci. Rep. doi: 10.1038/srep.27624
Khalid, S., Tabȩdzki, M., Rybnik, M., Adamski, M.: K3M: a universal algorithm for image skeletonization and a review of thinning techniques. Int. J. Appl. Math. Comput. Sci. 20 (2), 317–335 (2010)
MATH Google Scholar
Ciobanu, G., Păun, G., Pereez-Jimenez, M.J.: Applications of Membrane Computing. Springer, Heidelberg (2006). doi: 10.1007/3-540-29937-8
Zhang, G.-X., Liu, C.-X., Rong, H.-N.: Analyzing radar emitter signals with membrane algorithms. Math. Comput. Model. 52 (11), 1997–2010 (2010). doi: 10.1016/j.mcm.2010.06.002
Nishida, T.Y.: An application of P system: a new algorithm for NP-complete optimization problems. In: Proceedings of the 8th World Multi-conference on Systems, Cybernetics and Informatics (2004)
Păun, G., Pereez-Jimenez, M.J.: Membrane computing: brief introduction, recent results and applications. Biosystems 85 (1), 11–22 (2006). doi: 10.1016/j.biosystems.2006.02.001
Păun, G.: Tracing some open problems in membrane computing. Rom. J. Inf. Sci. Technol. 10 (4), 303–314 (2007)
Zhang, G., Liu, C., Gheorghe, M., Ipate, F.: Solving satisfiability problems with membrane algorithms. In: Fourth International Conference on Bio-Inspired Computing, BIC-TA 2009. IEEE (2009). doi: 10.1109/BICTA.2009.5338159
Song, T., Pan, L.: Spiking neural P systems with request rules. Neurocomputing 193 (12), 193–200 (2016)
Peng, H., Wang, J., Pereez-Jimenez, M.J., Shi, P.: A novel image thresholding method based on membrane computing and fuzzy entropy. J. Intell. Fuzzy Syst. 24 (2), 229–237 (2013). doi: 10.3233/IFS-2012-0549
Peng, H., Shao, J., Li, B., Wang, J., Pereez-Jimenez, M.J., Jiang, Y., Yang, Y.: Image thresholding with cell-like P systems. In: Proceedings of the Tenth Brainstorming Week on Membrane Computing, vol. 2, p. 03 (2012)
Zhang, Z., Peng, H.: Object segmentation with membrane computing. J. Inf. Comput. Sci. 9 (17), 5417–5424 (2012)
Peng, H., Wang, J., Pereez-Jimenez, M.J.: Optimal multi-level thresholding with membrane computing. Digit. Sig. Process. 37 , 53–64 (2015). doi: 10.1016/j.dsp.2014.10.006
Download references
Acknowledgments
This work is partially supported by The Malaysian Ministry of Higher Education under the fundamental research grant scheme (4F802 and 4F786). The authors would like to thank the Research Management Centre (RMC), Universiti Teknologi Malaysia (UTM) for their support in R&D.
Author information
Authors and affiliations.
Faculty of Computing, Universiti Teknologi Malaysia, 81310, UTM Skudai, Johor, Malaysia
Rafaa I. Yahya, Siti Mariyam Shamsuddin & Shafatnnur Hasan
Department of Computer, College of Science, University of Al-Mustansiriyah, Baghdad, Iraq
Rafaa I. Yahya
UTM Big Data Center, Ibnu Sina Institute for Scientific and Industrial Research, Universiti Teknologi Malaysia, 81310, UTM Skudai, Johor, Malaysia
Rafaa I. Yahya, Siti Mariyam Shamsuddin, Salah I. Yahya, Shafatnnur Hasan, Bisan Al-Salibi & Ghada Al-Khafaji
Department of Software Engineering, Koya University, Kurdistan Region, Iraq
Salah I. Yahya
School of Computer Sciences, Universiti Sains Malaysia, USM, 11800, Gelugor, Penang, Malaysia
Bisan Al-Salibi
Department of Computer Science, College of Science, Baghdad University, Baghdad, Iraq
Ghada Al-Khafaji
You can also search for this author in PubMed Google Scholar
Corresponding author
Correspondence to Salah I. Yahya .
Editor information
Editors and affiliations.
Xidian University, Xi’an, China
Maoguo Gong
Huazhong University of Science and Technology, Wuhan, China
Linqiang Pan
China University of Petroleum, Qingdao, China
Faculty of Engineering, Computing and Science, Swinburne University of Technology Sarawak Campus, Kuching, China
Gexiang Zhang
Rights and permissions
Reprints and permissions
Copyright information
© 2016 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper.
Yahya, R.I., Shamsuddin, S.M., Yahya, S.I., Hasan, S., Al-Salibi, B., Al-Khafaji, G. (2016). Image Segmentation Using Membrane Computing: A Literature Survey. In: Gong, M., Pan, L., Song, T., Zhang, G. (eds) Bio-inspired Computing – Theories and Applications. BIC-TA 2016. Communications in Computer and Information Science, vol 681. Springer, Singapore. https://doi.org/10.1007/978-981-10-3611-8_26
Download citation
DOI : https://doi.org/10.1007/978-981-10-3611-8_26
Published : 08 January 2017
Publisher Name : Springer, Singapore
Print ISBN : 978-981-10-3610-1
Online ISBN : 978-981-10-3611-8
eBook Packages : Computer Science Computer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
- Publish with us
Policies and ethics
- Find a journal
- Track your research
IMAGES
VIDEO
COMMENTS
We provide a comprehensive review of this recent literature, covering the spectrum of pioneering efforts in semantic and instance segmentation, including convolutional pixel-labeling networks, encoder-decoder architectures, multiscale and pyramid-based approaches, recurrent networks, visual attention models, and generative models in adversarial ...
Image segmentation is an essential phase of computer vision in which useful information is extracted from an image that can range from finding objects while moving across a room to detect abnormalities in a medical image. As image pixels are generally unlabelled, the commonly used approach for the same is clustering.
In this survey, we provide a comprehensive review of the literature at the time of this writing, covering a broad spectrum of pioneering works for semantic and instance-level segmentation, including fully convolutional pixel-labeling networks, encoder-decoder architectures, multi-scale and pyramid based approaches, recurrent networks, visual att...
Several image segmentation techniques have been developed by the researchers in order to make images smooth and easy to evaluate. This paper presents a literature review of basic image...
Our survey covers the most recent literature in image segmentation and discusses more than a hundred deep learning-based segmentation methods proposed until 2019. We provide a comprehensive review and insights on different Fig. 1. Segmentation results of DeepLabV3 [12] on sample images.
(1) Introduction Figure-ground segmentation referred as a target or foreground other part is called background is an important problem i.e., extract and separate them in order to identify and analyze object, in image processing [2, 3]. Segmentation is the process that subdivides an image into its constituent parts or objects [1...22].
To compile the vast literature on machine learning and deep learning-based segmentation techniques and proffer statistical, comprehensive, semi-automated, and application-specific analysis, which could contribute to the ongoing research. 16,674 studies have been filtered out from the pool of 22,088 studies collocated by executing a search string...
The essential step in digital image processing is segmentation which can be used to partition the images into particular regions or objects and the level of partitioning depends on the individuality of the problem being solved. Segmentation of the image is widely categorized into two. The first one is Discontinuity which measures the sudden ...
mization techniques in the context of image restoration, stereo and image segmentation in order to compare the speed of the different methods 2.4.2 Graph Cuts for image segmentation 1. Boykov and Jolly (2001a) introduce a technique for segmentation using a graph to rep-resent the image, and then using a Min-Cut/Max-Flow algorithm to segment the ...
A literature review of basic image segmentation techniques from last five years is presented, highlighting the importance of recent research in each technique. Segmentation is considered as one of the main steps in image processing. It divides a digital image into multiple regions in order to analyze them. It is also used to distinguish different objects in the image.
Image segmentation is an essential phase of computer vision in which useful information is extracted from an image that can range from finding objects while moving across a room to detect abnormalities in a medical image. As image pixels are generally unlabelled, the commonly used approach for the same is clustering.
Medical image segmentation aims to make anatomical or pathological structures changes in more clear in images; it often plays a key role in computer-aided diagnosis and smart medicine due to the great improvement in diagnostic effi- ciency and accuracy.
This paper presents a literature review of basic image segmentation techniques from last five years. Recent research ... A Survey: Image Segmentation Techniques 89 International Journal of Future Computer and Communication, Vol. 3, No. 2, April 2014 DOI: 10.7763/IJFCC.2014.V3.274.
Considering state of-the-art methods and their performance, the purpose of this paper is to provide a comprehensive survey of three, recently proposed, major brain tumor segmentation and classification model techniques, namely, region growing, shallow machine learning and deep learning.
A good literature survey of the colour image segmentation using fuzzy logic is presented in the literature [197, 198]. The fuzzy c -means (FCM) clustering algorithm [199] is the most popular method based on membership values of different classes.
In Section 4, the importance of deep learning of essential medical image tasks is described as image classification, detection, segmentation, recording, research, and im-provement. In Section 5, we review application-based profound learning frameworks. In Section 6, we calculate the overall effectiveness of performance using evaluation mea-sures.
Segmentation in large-scale cellular electron microscopy with deep learning: A literature survey - ScienceDirect Skip to main contentSkip to article Journals & Books Search RegisterSign in ViewPDF Download full issue Search ScienceDirect Medical Image Analysis Volume 89, October 2023, 102920 Survey paper
Image Segmentation Using Deep Learning: A Survey is a comprehensive review of the state-of-the-art methods and challenges in the field of image segmentation. The paper covers more than 100 segmentation algorithms proposed till 2019, and provides a taxonomy of 10 categories based on the techniques and applications. The paper also discusses the evaluation metrics, datasets, and future directions ...
1. Introduction Deep learning approaches related to artificial intelligence (AI) algorithms, medical image segmentation, and medical image classification may have the most significant, long-term influence on a large number of individuals in a small amount of time.
A literature survey of MR-based brain tumor segmentation with missing modalities https://doi.org/10.1016/j.compmedimag.2022.102167 A brain tumor is a growing abnormal cell in the brain or central spine canal, which is one of the most life-threatening cancer.
Carnero et al. [ 52] presented an implementation of a membrane solution for digital images for the removal of redundant and irrelevant features, edge-based segmentation and thresholding using hardware programming. Field Programmable Gate Array (FPGA) is incorporated into the hardware tool.
The nature inspired optimization algorithms are very promising with image segmentation techniques to provide a platform for processing of satellite images. In this paper a literature review of ...