0:00:15a lower everyone and one car oh i'm from boston university a be talking about our work uh on uh
0:00:20multi energy x-ray computed tomography for explosives detection
0:00:23this is work of my student are our student will more you're uh in our collaborators and how do home
0:00:28or P N from M G H and percussion ish for my call from boston
0:00:32first
0:00:34so a quick overview um
0:00:37in finding explosive materials like at the airport i'm sure we've all experienced having our bags skin
0:00:42uh
0:00:43you can discriminate materials uh using multi energy three
0:00:46computed tomography the X ray buys you the ability to look inside things without impacting packing them
0:00:51our focus is on uh
0:00:54a so called attenuation versus energy curves of materials i describe those in a bit
0:00:58and our interest is in take you learning based perspective seen what the data tells us about this problem
0:01:04uh will study the dimensionality in the span of the set of curves that the fine materials
0:01:08and we'll look at what happens when we go classifiers using different choices of features
0:01:13what i hope to convince you is that there's the potential for improvement over existing methods in uh in these
0:01:18techniques by taking a learned based perspective
0:01:20and uh i hope to show that uh using different choices of features and the conventional sh choice
0:01:26tension by you something and using a more features than the conventional uh choice of two features can potentially by
0:01:32something
0:01:33so a little bit of overview of explosive detection by multi energy uh x-ray ct
0:01:38so uh
0:01:40unit demography let's you look inside things without opening the bags and taking everything out so C T by Z
0:01:45the ability to
0:01:45penetrate at rate materials
0:01:47multi energy ct by you the ability to discriminate different material types
0:01:52uh so you can kind of think of it as a spectrographic type of an now
0:01:56a focus of this work all talk about the day is what the fundamental information available in these kinds of
0:02:01measurements is
0:02:02and again to try to take a learning based perspective try to see what data
0:02:05or measurements of this type uh has to say about our ability to discriminate materials
0:02:10and to try to focus a bit on what the best choice of features is if you know you wanna
0:02:14do material discrimination not just make picture
0:02:17so here i have
0:02:18uh uh uh a colour coded X ray picture give V the idea here's the kind of thing see in
0:02:23the airport
0:02:24and this is the kind of thing that is typically done now where there's two features that are extracted and
0:02:28you try to cluster materials
0:02:29this two dimensional features
0:02:32okay a little bit of physics so we understand where the information is
0:02:36so X rays well any time you do X very ct of course the modalities X rate based and so
0:02:41the interaction of X rays
0:02:42uh with materials is where the information gonna come from
0:02:46uh the key a a quantity for us as what's called the linear attenuation coefficient or the L A C
0:02:52oh which is denoted by the symbol new of the up here
0:02:55uh basically new V tells you about the uh uh the number of photons that are lost uh as they
0:03:01propagate through material
0:03:02a and that comes through physics from beers law which is down here
0:03:06if you put a number of photons i zero into a homogeneous material of length L
0:03:11there is the L
0:03:13a the number of photons a uh the come out
0:03:16a follows this law i zero E to the minus you we of L
0:03:19and
0:03:20the number of photons lost is given by this uh parameters
0:03:24slash function you of the
0:03:26uh the thing to note is that that you of V depends on the photon energy so if you put
0:03:30in photons of different energy here
0:03:32the attenuation will be different depending on the energy of those vote so this you of V the a curve
0:03:38a a new in this axis your somebody's curves over here you in this axis energy or you on this
0:03:43axis
0:03:44which defines the attenuation as a function of energy so you can see that for most materials
0:03:48lower energy
0:03:49photons are absorbed at a higher rate than high energy
0:03:54so we material has a curve of this sort so here's the curve that you'd see for lead
0:03:58here's the curve you'd see for say water and there's another curve for hunting
0:04:02and so when you do X ray based uh interrogation materials what you're really are getting in at is the
0:04:07differences in these curves that's that that's how the materials in pack
0:04:11a a a a a the measurement
0:04:13and you can see there's some interesting features somebody's curves at discontinuities called K edges that occur at different locations
0:04:19and so the basic ideas from measurements uh X ray measurements what we wanna do with associate the extra measurements
0:04:25what this L A C these per and with the L A C we can associate with material so that's
0:04:30kind of the that picture where we're gonna go
0:04:34okay now what's typically done in in uh
0:04:37X ray based multi energy x-ray imaging is that the uh a linear uh attenuation coefficient is assumed separable and
0:04:43space an energy
0:04:45and so these news uh these functions are a function of both space and energy
0:04:50uh and we do some sometime of uh of decomposition where we split what out the energy of part from
0:04:55the spatial part
0:04:56so the spatial part is the volumetric thing that tells you the distribution of materials
0:05:01uh we decide on some energy functions that describe the space of these curves
0:05:05and then the goal is from the X measurements to find these coefficients a K
0:05:10so here's sort of a notional diagram of that
0:05:12the you E the the energy curve
0:05:15as is decomposed in this picture in the two different functions
0:05:18this is
0:05:18a a a common standard choice of functions using the photo like so called photo electric function the comp function
0:05:24and so you write the overall attenuation per
0:05:27as some coefficient times this curve
0:05:29plus a different coefficient times this curve
0:05:32uh and you try to find these coefficients at an A C
0:05:35some more generally you get the pick these functions
0:05:37and you try to find his coefficients so overall all again the picture i having your head is that at
0:05:42the end of the day you try to find school fashion
0:05:44say a vector of coefficients and those vector of coefficients to find a material
0:05:51okay now
0:05:52historically the medical world sort of drove this kind of multi energy X ray work in in the medical world
0:05:57the kinds of things you're looking at are the body
0:05:59biological tissues
0:06:01and the universe of biological kind of materials is relatively small mostly we look like water make we have phone
0:06:07and it in that domain it we shown that the the the space of materials was well represented as two
0:06:12dimensional
0:06:13and uh the particular two-dimensional dimensional functions that were originally proposed where the photo electric and the constant functions
0:06:19and so the the world kind of evolve along on this
0:06:22two dimensional point
0:06:24uh a and the choice of basis being you the focused on for electric and compton basis functions
0:06:28and sometimes people choose another two basis functions that are based on their application in the medical world up P
0:06:34sort of extreme of things like soft if you and bound
0:06:37but the space is generally a two dimensional space and since they know that the functional space
0:06:41uh the spinning space as dimensional
0:06:43that leads to skinner's that
0:06:45uh
0:06:45only exploit a to energy spectra in the skinning so you sort of take measurements at two energies
0:06:51you try to extract these coefficients for these two functions at that and a two dimensional space
0:06:56this is propagated of the security don't where it's nominated by a dual energy uh machines trying to extract two
0:07:03dimensional features and displaying them in a two dimensional space and trying to be cluster
0:07:07but you think about the security domain main the space of uh materials is much greater than and the biological
0:07:12space i mean it since S since anything you can think about putting into a suitcase
0:07:15and so you have much less control about what goes into
0:07:18the scanner
0:07:19and that the universe materials as much greater
0:07:22so perhaps it shouldn't be surprising that
0:07:24you might expect that that them
0:07:26a dimensionality space might increase
0:07:28okay so what
0:07:30so this is a what our hypothesis is is that we might wanna be interesting
0:07:34a higher dimensional features a higher dimensional uh spanning space
0:07:38and a perhaps different features than this photo electric and compton expansion set or the corresponding call
0:07:47now there's an additional piece here and that's that rather than imaging the medical world is always focused on imaging
0:07:51is in a
0:07:53explosives detection were interested more in discrimination
0:07:56it's not so much making the picture it's it's more or less saying look you have something that's gonna explode
0:08:00in the bag
0:08:01and so for that we're trying to get these features that we're gonna be using to do classification
0:08:06now let me go back for a minute to the x-ray sensing so there's this process where the material bag
0:08:12the body whatever is in the scanner
0:08:14you're gonna take a bunch of these projection measurements and from that at the end of the day you're gonna
0:08:18try to estimate these coefficients these a K and the expansion
0:08:22uh expansion function
0:08:23so at a high level we can kind of you the left hand side as the measurements projection from
0:08:28and there's some nonlinear perhaps messy
0:08:31why roll tomographic kind of measurement
0:08:33and so there's some on linear transformation of the thing that you want these coefficients that define the material perhaps
0:08:39spatially distributed across the line
0:08:42so for our purposes where we're gonna take this abstract view of the tomographic problem you get measurements and from
0:08:47those you're gonna try to extract the a case
0:08:50yeah case or would fundamentally defined find material
0:08:53okay through this equation where you this expansion
0:08:56uh so if you change the basis expansion
0:08:59when you try to estimate these a case you're changing the feature space
0:09:02so the the viewpoint point we have is this is that choosing these basis is really the choice of the
0:09:07classification space
0:09:09in the work that we're gonna do we're gonna suppress the worry about demography we're gonna focus on the basis
0:09:14choice
0:09:14okay so that's this were
0:09:16so here again no only a kind of describe that is yours a bunch of explosive materials class one
0:09:21there's a bunch of non explosive potential confuse or is class zero
0:09:24each of these explosive materials has some L A C associated with that an an explosive ones have some L
0:09:29A C so there's a universe of L A C over here
0:09:32a different universe of L A Cs over here
0:09:34and what we're gonna wanna do is choose these expansion things uh a um
0:09:38basis functions so that the coefficients
0:09:40which are features help us to doing discrimination between the two classes
0:09:45okay now the approach that we've take initially
0:09:47is just to take a a a uh
0:09:49a universe of the
0:09:51uh we take a bunch of uh labeled samples some explosive some non explosive we discrete eyes them
0:09:57and we stick them as columns in double major so we have the T N T yell A see the
0:10:01honey L a C all the way up to the R X L A C so we have material one
0:10:05this access
0:10:06we have the uh uh the values of the curves of different energies coming down you along each column
0:10:11and then we apply singular value decomposition analysis
0:10:14what we're gonna do was look at these functions the singular value functions and different combinations of them as different
0:10:20choices of a a uh is that we can extract features from
0:10:24or we're gonna look at the singular values to tell us about the relative importance of these different feature
0:10:29okay okay
0:10:32so i
0:10:33a experiments so experiment number one is
0:10:35is
0:10:36trying to make a move towards understanding the space of explosive materials both the dimensionality and sort of what it
0:10:41might look like
0:10:42so the first thing you can do well first let me take the experiment we took a for explosives fourteen
0:10:46non explosive
0:10:48we discrete eyes them do a hundred forty one energy level so each L A C is essentially now hundred
0:10:53hundred forty one dimensional vector
0:10:54and we stack them up in this matrix and we do S V D well i forgot to add we
0:10:58we discrete tries them over the essentially the diagnostic range from ten K V up to a hundred fifty K
0:11:03T V
0:11:04that's typically the range the gets measured in an uh
0:11:07ct T machine
0:11:08uh and we apply the svd so over here i have the singular values i ordered as a function of
0:11:13index
0:11:14and again i go back to remember the conventional approach says that that's space materials is is well uh characterised
0:11:20as a two dimensional subspace case so you should only need
0:11:24two functions to span it
0:11:26so if that was try to the svd analysis should show on them too large singular values and the rash
0:11:31be insignificant
0:11:32but as you can see there is one up here there's two three four five six seven you can see
0:11:37that this thing isn't one or two and then dropping down to zero
0:11:40it actually rolls off relatively slowly and it looks like based on this analysis they're significantly more than two
0:11:46uh the to the feature space of at least explosive materials these are biological anymore more
0:11:51so this was our first interesting result
0:11:53that says that uh hmmm maybe we wanna use a larger than a two-dimensional space
0:11:57the other thing is if if you think okay maybe a a well approximated by the first two singular value
0:12:02those first to uh uh a a single functions corresponding to these first two singular values are shown here
0:12:07and just for reference like put the the standard two functions the photo content functions down here
0:12:13notice these are very smooth
0:12:14to smooth functions to represent materials
0:12:17the first two singular functions are not very smooth they have these discontinuities
0:12:21but remember a lot of these materials can have things like these K had just discontinuity so this was a
0:12:25another interesting observation
0:12:27yeah i you might say is okay two functions to functions they look different but maybe they span the same
0:12:32space but even that's not true
0:12:34if you look at the angle between the subspace spanned by the first two singular functions and the subspace in
0:12:39by the for constant functions
0:12:41the between them sixty eight degree so it's not like they're the same functions
0:12:45okay so there's a lot of difference here
0:12:49or second experiment was to look at the effect of a feature dimensionality on classification for four
0:12:55so we have the same setup as before the same a universe of explosives and non explosive the same discrete
0:13:00as a nation the same stacking in the S P D
0:13:03okay
0:13:03and what we did here was we look you know order at a singular or uh values and the singular
0:13:08vectors
0:13:09we divided the data randomly into an eighty percent take training twenty percent test set
0:13:13and then for a different numbers of features going in order uh according to the S P D
0:13:19we trained a classifier and then tested the performance
0:13:21a classifier so we only picks say one feature the first single or of uh function
0:13:26use that
0:13:27and we used one in two then we use one two one three one two three and four
0:13:31and and re repeated this for different numbers of features and then we look at what happens to the classification
0:13:36performance
0:13:37as you increase the dimensionality of the space in which you represent B
0:13:41okay okay
0:13:42so you can see what happens here we and we did cross validation on that
0:13:45so if you start with a one your performance is down here one into your performance down here as you
0:13:49go to three an improve
0:13:51or five six to jumps up and when you get to seven or eight it
0:13:53it jumps up and then it seems to local law
0:13:56so that this access is about sixty five percent correct classification here at eighty five percent correct classification
0:14:02so this seems to suggest that there's some dramatic room for improvement by increasing the dimensionality of the feature space
0:14:09that you represent materials in at we at least for explosives tech
0:14:12in this is sort of counter the conventional wisdom which is always been focused on a two dimensional feature space
0:14:18centered around for electric in comp
0:14:22okay K third experiment so so those speeches were chosen in order so when we chose a a um two
0:14:27features we chose the largest us to singular value
0:14:30what we did next was we fixed the number of features i E the dimensionality of the space to be
0:14:34to the same as the photo compton choice
0:14:36but now we looked at different combinations of S uh a single or function
0:14:40we tried to see what happened as we went through all the different pairs you could imagine so essentially we're
0:14:44comparing different choices of two dimensional feature space
0:14:47so the dimensionality is fix but we're looking over the different sub-spaces
0:14:52okay so the same set same explosive saying non explosives same cross validation eighty twenty split i'll
0:14:58so here are the choices that we may so this is singular functions one into one and three one and
0:15:03four two one three two one four three and four
0:15:06over here to the right is the performance of the photo compton choice this particular conventional two dimensional feature space
0:15:12and we can see that the conventional two-dimensional a photocopy in choice of the two dimensional feature space gives you
0:15:18about
0:15:18sixty six percent correct classification
0:15:21as you go through these different
0:15:22pair choice lots of them are very similar but this one one and four seems to perform much better
0:15:27so this seems to suggest that again even if you want to limit
0:15:31yourself to a two dimensional feature space
0:15:33that the conventional choice of photo comp and may not be the best and that there might be room and
0:15:37a classification context
0:15:39the optimize this choice to get a better classification of a particular
0:15:43a folk it's classes of materials then a uh a has been carried over a traditionally from the matter
0:15:50okay so our conclusions here in this initial work
0:15:53is that well we study this problem of material classification from X ray based L C feature
0:15:59okay
0:15:59we took a learning based approach we used uh a actual curves of materials and we said what is the
0:16:04data tell us about this we kind of took a first principles approach look at the dimensionality of the space
0:16:10look at the choice of the space and tried to see whether there was room for improvement
0:16:14our initial results seem to suggest that there's the per potential for improvement
0:16:17both in terms of increasing the dimensionality
0:16:20and then optimising the choice for any given dimension
0:16:23so this was an initial work
0:16:25we limited ourselves to svd analysis what we've been working on since the time we did this
0:16:29is trying to break out of that S P D paradigm "'cause" there's nothing that says that the S D
0:16:34uh um
0:16:35svd based singular functions are the right functions to represent things
0:16:39and so we've been sort of trying to a a push this for
0:16:43thank you
0:16:56um
0:16:58you talk about
0:17:00right
0:17:00class
0:17:01patient
0:17:02i would have thought that you know
0:17:05or
0:17:06we you false alarm
0:17:08problem
0:17:09section probably not of
0:17:10you for
0:17:11i mean
0:17:12in
0:17:12classifying something
0:17:14close
0:17:15is probably not
0:17:17a missing
0:17:19yeah there's lots of choices you can do a and and the
0:17:22working up some of that stuff i mean we've done some additional work in doing things
0:17:27a a so so this pick some particular classifier an svm based when your for kernel classifier and then looks
0:17:33at correct classification for that class of part we've also done work
0:17:36and just basically what's the uh
0:17:38the choice of things that sort of a
0:17:40as the most information
0:17:42so one way you can measure that is
0:17:43for example a area under the roc
0:17:45oh the things you can do or you can fix false alarm rates and look at P B we've been
0:17:49plane with all of that so you i mean you're right i agree with you
0:17:53is just the plumbing
0:18:01it's the second to last Y
0:18:04and the one that know the that yeah yeah the but one no one for seems to work a lot
0:18:09better than the others
0:18:10yeah is the fact that that's that an outlier is that in into the result three
0:18:14not at all
0:18:15i the
0:18:16first of all the the svd features
0:18:18you you know the single functions you get are are are physically but
0:18:22so there's nothing i mean we've looked at them there you use all the first two there's nothing the jumps
0:18:26out that says these look like
0:18:27certain materials for example
0:18:29so no i would say nothing into about that result
0:18:32to me
0:18:34yeah
0:18:40composition position on
0:18:43exponential decaying function
0:18:45am i correct
0:18:46the the
0:18:48on on the functions they're not necessarily exponentially okay
0:18:51yeah but but the yeah the non to have generally have the proper okay
0:18:55if you thought of utilizing other functions because some of the ones you showed have these we use an this
0:19:00got do it is that not well express
0:19:03in that that function
0:19:05yeah maybe a misunderstanding your question i mean the the those curves are what they are for materials what we
0:19:10did was we stack them up and did in S P D so the singular functions of that universe or
0:19:14just gonna be what they are they're not parametric be
0:19:16they are not being parametrically represented a i thought that i thought you were a but a metric known no
0:19:21we present a there it's a discrete eyes world so they just turn out to be what they are we
0:19:25we
0:19:26well i i don't where i'm running a i'm i'm pass can time we'll we'll talk of