# on_the_parameterized_complexity_of_belief_revision__26f64ccb.pdf On the Parameterized Complexity of Belief Revision Andreas Pfandler1,2, Stefan R ummele1, Johannes Peter Wallner1, and Stefan Woltran1 lastname@dbai.tuwien.ac.at 1Vienna University of Technology, Austria 2University of Siegen, Germany Parameterized complexity is a well recognized vehicle for understanding the multitude of complexity AI problems typically exhibit. However, the prominent problem of belief revision has not undergone a systematic investigation in this direction yet. This is somewhat surprising, since by its very nature of involving a knowledge base and a revision formula, this problem provides a perfect playground for investigating novel parameters. Among our results on the parameterized complexity of revision is thus a versatile fpt algorithm which is based on the parameter of the number of atoms shared by the knowledge base and the revision formula. Towards identifying the frontier between parameterized tractability and intractability, we also give hardness results for classes such as co-W[1], para-ΘP 2, and FPTNP[f(k)]. 1 Introduction Belief revision [Alchourr on et al., 1985] is a core formalism of Artificial Intelligence (see e.g. [Peppas, 2008]) aiming for a formal way of adapting one s beliefs in the light of new information. Following Katsuno and Mendelzon [1991], we consider revision in the setting where beliefs and new information are given as propositional formulas. Operators like the one by Satoh [1988] characterize the result of revision by a set of models representing the adapted belief base. Understanding the computational complexity of reasoning is an indispensable step towards the design of practically efficient systems. Unfortunately, Eiter and Gottlob [1992] have shown that many revision operators suffer from a high computational complexity in the general case of propositional logic. For instance, deciding whether a formula follows from the result of a revision in terms of Satoh s operator has been shown to be ΠP 2-complete. Those results were later strengthened in terms of model checking by Liberatore and Schaerf [2001]. While these two papers studied easier cases in terms of the HORN fragment, other fragments that might lead to tractability have Supported by the Austrian Science Fund (FWF) under grants P25518, P25521, and Y698, and the German Research Foundation (DFG) under grant ER 738/2-1. not been thoroughly investigated; a recent analysis [Creignou et al., 2013] for KROM formulas being a notable exception. Inspecting these results, it becomes clear that tractability requires rather strong restrictions on the involved formulas, i.e., the knowledge base and the revision formula. On the other hand, these components might be of vastly different size and shape. For exploiting this potential heterogeneity of the two components towards novel tractability results, parameterized complexity and parameterized algorithmics [Downey and Fellows, 1999] are the formal tools of choice. Here the complexity is not measured with respect to the input size alone but also with respect to one or multiple features of the instance that are expressed as an integer value, the socalled parameter. Parameterized complexity has been investigated already in several AI domains (see e.g. [Fellows et al., 2012; Gottlob and Szeider, 2008; Gottlob et al., 2010; Lackner and Pfandler, 2012]) and such results have been successfully put to practice, in particular in the area of argumentation [Dvoˇr ak et al., 2012; 2014]. In this paper we utilize parameterized complexity theory for belief revision with the aim to keep the restrictions on the theory and new information as independent and relaxed as possible without destroying tractability. Our analysis not only gives new insights on the different sources of complexity of revision, but also provides the basis for novel implementations. We shall focus here on Satoh s operator and start our analysis by generalizing already established tractable cases from [Eiter and Gottlob, 1992] as well as the only fpt result we are aware of, viz. [Pichler et al., 2009] which utilizes the combined treewidth parameter. The main contributions of our work are: We generalize existing tractability results due to Eiter and Gottlob [1992] via backdoors to Horn and show certain limits of the treewidth approach, in particular we provide paraco NP-hardness if treewidth is bound independently in the knowledge base T and the revision formula ϕ. Furthermore, also combining bounded treewidth of ϕ with the restriction of T to be Horn results in para-co NP-hardness. Towards a generic algorithm, we identify a novel parameter, namely the cardinality of the variables shared by knowledge base T and revision formula ϕ. Our algorithm is fpt when adding (possibly independent) parameters that make T s and ϕ s satisfiability fpt. We show that these additional bounds are necessary, since otherwise completeness for the class FPTNP[f(k)] is obtained. FPTNP[f(k)] contains prob- Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015) lems that can be computed by an fpt-algorithm that may make f(k) many NP oracle calls. From a practical perspective, this result is interesting since it shows that the problem at hand can by implemented via an iterative SAT-procedure. Finally, we show that a relaxation of the bound on the shared vocabulary to a bound on the maximum symmetric distance between models of T and ϕ is less promising since this increases the complexity to para-ΘP 2-hardness. 2 Background Propositional Logic. We consider propositional logic over some fixed universe U of propositional atoms and standard connectives , , and . A literal is an atom a or a negated atom a. A clause is a set of literals. A clause is called Horn if at most one of its literals is positive. Unless otherwise stated, formulas are in conjunctive normal form (CNF). For formula ϕ we denote the set of its clauses by C(ϕ) and its set of atoms by var (ϕ). A formula is called Horn if all of its clauses are Horn. We denote by HORN the class of Horn formulas. We represent an interpretation by a set I U containing all variables set to true. If interpretation I satisfies formula ϕ, we call I a model of ϕ, denoted by I |= ϕ. By Mod(ϕ) we denote the set of models of ϕ (over U). For formulas ϕ and ψ we denote by ϕ |= ψ that Mod(ϕ) Mod(ψ). A truth assignment τ for a set V U is a function that assigns a truth value to each variable in V . We denote by ϕ[τ] the formula obtained from formula ϕ by deleting all clauses satisfied by τ and by deleting all literals that are set to false by τ from the remaining clauses. Belief Revision. The problem of belief revision is specified as follows: Given a knowledge base (i.e., a formula) T and a formula ϕ, find a revised knowledge base T ϕ, such that ϕ is true in all models of T ϕ and the change compared to the models of T is minimal . Note that T, ϕ and ψ are throughout the paper assumed to represent theory, revision formula and query formula. The approach to belief revision we deal with in this paper relies on a so-called model-based operator. Such operators usually utilize a model distance M M = (M \ M ) (M \ M) which yields the set of atoms differently assigned in interpretations M and M . Assuming that T is consistent (we tacitly make this assumption throughout the paper), the operator due to Satoh [1988] can be defined as follows: Mod(T ϕ) = {J Mod(ϕ) | I Mod(T) s.t. I J min(T, ϕ)}, min(T, ϕ) = min {I J | I Mod(T), J Mod(ϕ)}, with min selecting minimal elements with respect to set inclusion. The decision problem BR is ΠP 2-complete even in case ψ is a single atom [Eiter and Gottlob, 1992]. Cautious (or skeptical) reasoning. (BR) Instance: CNF formulas T and ϕ, and arbitrary formula ψ with var (ψ) var (T) var (ϕ). Problem: Decide if T ϕ |= ψ holds. Parameterized Complexity. Recall that FPT denotes the class of parameterized problems for which there exists an algorithm that decides the problem in time f(k) n O(1), where f( ) is an arbitrary computable function that only depends on the parameter k. A parameterized reduction of a parameterized problem Π to a parameterized problem Π is an fpt algorithm that transforms an instance (I, k) of Π to an instance (I , k ) of Π such that: (i) (I, k) is a yes-instance of Π if and only if (I , k ) is a yes-instance of Π , and (ii) k = g(k), where g( ) is an arbitrary computable function that only depends on k. Hardness and completeness with respect to parameterized complexity classes is defined analogously to the concepts from classical complexity theory, using parameterized reductions. The following parameterized classes will be needed in this paper: FPT co-W[1] para-co NP FPTNP[f(k)] para-ΘP 2. The class co-W[1] is the co-class of W[1], the first level of the so-called W-hierarchy. A prominent complete problem for W[1] is the INDEPENDENT SET problem parameterized by the size of the required independent set [Downey and Fellows, 1995]. Hence its co-problem is complete for co-W[1]. Parameterized problems in the W-hierarchy share the property that they can be solved in polynomial time if the parameter value is fixed to a constant. On the other hand para-co NP and para-ΘP 2 contain those parameterized problems that can be reduced via a parameterized reduction to a co NP-complete or ΘP 2-complete problem respectively. The class FPTNP[f(k)] was recently introduced by de Haan and Szeider [2014b] and contains all problems that can be solved by an fpt-algorithm that can use f(k) many calls to an NP oracle [de Haan and Szeider, 2014a]. Two important parameters that we use in this paper are treewidth (see e.g. [Bodlaender, 1993]) and backdoors (see e.g. [Gaspers and Szeider, 2012]). Treewidth and Backdoors. A tree decomposition of a graph G = (V, E) is a pair (H, χ), where H is a tree and χ maps each node t of H (we use t H as a shorthand below) to a bag χ(t) V , such that (i) for each v V , there is an t H, s.t. v χ(t); (ii) for each {v, w} E, there is an t H, s.t. {v, w} χ(t); and (iii) for each t1, t2, t3 H, s.t. t2 lies on the path from t1 to t3, χ(t1) χ(t3) χ(t2) holds. The width of a tree decomposition is defined as the cardinality of its largest bag χ(t) minus one. The treewidth of a graph G, denoted as tw(G), is the minimum width over all tree decompositions of G. To build tree decompositions for propositional formulas, we use their incidence graphs. For formula χ such a graph consists of a vertex for each clause and each variable occurring in χ, and has as edges all unordered pairs {x, c} where x var (χ) appears in clause c C(χ). A strong HORN-backdoor set of a propositional formula χ is a set B of variables such that χ[τ] HORN for each truth assignment τ over the variables B. This means, the cardinality of such a HORN-backdoor set measures the distance of χ to the class of HORN formulas. We denote with B(χ) the smallest HORN-backdoor set of χ. 3 Horn, Treewidth and Beyond We start with an fpt-result for the setting where |var (ϕ)| is considered as the parameter and where T is HORN. Actually, this result is implicit in the proof of [Eiter and Gottlob, 1992, Theorem 8.3], where a polynomial time result was shown if the length of ϕ is bounded by a constant. Proposition 1. (implicit in [Eiter and Gottlob, 1992, Theorem 8.3]) BR parameterized by |var (ϕ)| is fpt if T HORN. A successful technique to generalize tractability results is to move from the restrictions to HORN formulas (or other tractable fragments of SAT) to the backdoor approach and use, e.g., strong HORN-backdoor sets. Using this formalism it is possible to generalize the result of Proposition 1 from the restriction to HORN formulas to propositional formulas which are close to being HORN and hence have a small backdoor. Theorem 2. BR parameterized by |B(T)| + |var (ϕ)| is fpt. Proof. Let B be a strong HORN-backdoor set of T. The basic idea is to iterate over all (2|B| many) assignments τ to B and to simplify T accordingly. Since T[τ] HORN, checking whether (T[τ] ϕ) |= ψ holds is in FPT by Theorem 1. Notice that this result does not hold if BR is parameterized by |B(T)| only. In fact, BR remains co NP-complete if T, ϕ HORN [Eiter and Gottlob, 1992, Theorem 7.2], which also immediately yields para-co NP-hardness. Another important structural parameter is the combined treewidth of T, ϕ, and ψ. Proposition 3. [Pichler et al., 2009, Theorem 1] BR is fpt when parameterized by tw(T ϕ ψ). These initial fpt results possess quite strong conditions on T and ϕ. As we will see in the next section, the key to gain more versatile fpt results is to parameterize on joint properties of T and ϕ. Before that, we show that further independent relaxations on T and ϕ indeed increase complexity. Our first result in this direction is concerned with the situation when treewidth of T as well as of ϕ are bound individually. Then, we study the case of bound treewidth on ϕ where T is HORN. Theorem 4. BR is para-co NP-hard if parameterized by tw(T) + tw(ϕ). Proof. We show co NP-hardness for the acyclic case, i.e., tw(T) = tw(ϕ) = 1 via reduction from the SAT problem. There we are given a formula χ in CNF and have to decide whether χ is satisfiable. Given an instance of SAT χ = c1 c2 cm where c1, . . . , cm are clauses, we construct an instance (T, ϕ, ψ) of BR as follows. Let var (χ) = V . We create 2m new copies of the set V , denoted by V1, . . . , Vm and V 1, . . . , V m. For variable x V we denote the i-th copy by xi and the i-th copy of its primed version by x i. Additionally, let r be a new propositional variable. For clause ci of χ we replace its variables with their i-th copy and add the literal r. We call the resulting clause γi, e.g., for c2 = (x y z), γ2 = (x2 y2 z2 r). Then T = (γ1 γ2 γm) V x V V 1 i m(xi x i), ϕ = V x V V 1 i m(x i x) (x xi), and ψ = r. Note that the incidence graphs of T and ϕ are acyclic. Next, we show the correctness of the reduction. Assume that χ is a yes-instance, i.e., there exists M Mod(χ). We construct an interpretation M , which is a model of T and ϕ. For all x V and all 1 i m we assign x M iff xi M iff x i M iff x M. Additionally, r M . Since M satisfies all clauses ci, it holds that M satisfies all clauses γi. The additional implication clauses in T and ϕ are satisfied by M since all the different copies of the same variable agree on the truth value. Hence, M is indeed a model of T and of ϕ. Therefore, M Mod(T ϕ). But since r M , it follows that Mod(T ϕ) |= r. Hence, (T, ϕ, ψ) is a no-instance. For the other direction, assume that (T, ϕ, ψ) is a noinstance, i.e., there exists a model M Mod(T ϕ) with r M. First we show that M is a model of T ϕ. To this end, we show that there is an interpretation M , which is a model of T ϕ. This immediately yields min(T, ϕ) = { }. We construct the interpretation M as follows: Let r M and for all x V and all 1 i m we assign x M iff xi M iff x i M . The latter part ensures that all implication clauses in T and ϕ are satisfied. Since r M , it follows that M trivially satisfies all clauses γi, 1 i m. Hence, M is indeed a model of T ϕ and we have min(T, ϕ) = { }. Therefore, we know that M is a model of T ϕ, since M Mod(T ϕ) holds by assumption. Next we construct the interpretation M = M V and show that M is a model of χ. Since r M and each clause γi is satisfied by M, there is a literal from Vi in γi that is true in M. By construction, x M iff xi M and hence x satisfies also clause ci in M . Since this holds for all clauses c1, . . . , cm, interpretation M is indeed a model of χ and χ is a yes-instance. Theorem 5. BR is para-co NP-hard if parameterized by tw(ϕ) even if T HORN. Proof. Actually, we show co NP-hardness in the case where ϕ is acyclic, i.e., tw(ϕ) = 1. We give a reduction from the co-problem of the NP-complete INDEPENDENT SET problem. Let an instance of INDEPENDENT SET be given by G = (V, E) and k > 0. The question is, whether there exists a set of exactly k vertices V V such that there exists no edge between vertices in V . Let V = {v1, . . . , vm}. By slight abuse of notation we use the vertices of G also as propositional variables. Thus, we fix the set of variables var (T ϕ) = {r, v1, . . . , vm} {v1 1, . . . , v1 m, . . . , vk 1, . . . , vk m}, where for 1 i m the variables v1 i , . . . , vk i are k new copies of the variable vi and r is a new variable. Similar to the proof of [Lackner and Pfandler, 2012, Theorem 14] we make use of the following subformulas to encode the INDEPENDENT SET problem. The crucial difference in this proof is the distribution of the subformulas to T and ϕ. We define χIS = V {vi,vj} E( vi vj), χ1 = V 1 l k (vl 1 vl m), χ2 = V 1 i m V 1 l n d. This is a contradiction to n d being the maximum number of clauses simultaneously satisfiable for Γ. By the observations above, we know that {ad, r d} is a minimal symmetric difference we can find for M1 when comparing it to all models of T. We now show that there are no Mϕ |= ϕ and MT |= T such that Mϕ MT {ad, r d}. Due to the observations above, we cannot find such models such that the symmetric difference is a proper subset and does not contain ad. To achieve the symmetric difference of {ad} we would need a model of ϕ that assigns rd and r j to true for some j < d. This is a contradiction. Thus M1 Mod(T ϕ). The second case (ii) follows analogously, just note that we can find in this case a model of ϕ and model of T such that the symmetric difference contains only ad1. It follows that {M Mod(T ϕ) | M |= α} var (Γ) = {M | M satisfies a maximum number of clauses of Γ} var (Γ). We now show that (T, ϕ, ψ) is a yes-instance of BR iff Γ is a yes-instance of UOCSAT. Assume Γ is a yes-instance of UOCSAT. This implies that if an M Mod(T ϕ) satisfies α (M |= α) it holds that M |= β (otherwise M would encode two different interpretations of Γ satisfying a maximum number of clauses, but satisfying different clause sets). Thus M |= ψ. The other direction can be shown analogously: if two models satisfying a maximum number of clauses for Γ exist, s.t. they satisfy different clauses, then there is an M Mod(T ϕ), s.t. M |= α, M |= β, and q / M. We complement this result by an upper bound on the required number of calls to a SAT-solver in order to solve the problem. The number of possible symmetric differences projected to the shared variables S is bounded by Pd i=0 |S| i , with d the maximum Hamming distance. We can bound this by Pd i=0 |S| i (1 + |S|)d. Thus, we can bound the number of required NP oracle calls by O((1 + |S|)d). 6 Discussion In this work we have studied the parameterized complexity of belief revision for parameters beyond treewidth. We summarize our results in Table 1. In particular, we have explored to what extend it is possible to decouple the theory from the revision formula. The parameter shared variables turned out to be crucial to obtain fpt-results in the decoupled setting. Ultimately, this parameter led to a versatile, modular fpt-result where tractable fragments of the theory and the revision formula can be combined arbitrarily. Moreover, if we do not rely on tractable fragments the problem becomes complete for the recently introduced class FPTNP[f(k)]. This result is interesting as it adds a natural problem to this rather unexplored class, and, furthermore, it shows the applicability of a SAT-based procedure that can solve the problem with a restricted number of calls if the parameter is bounded. Our result also complements the work of Delgrande et al. [2007], who presented algorithms and implementations based on SAT-solvers for belief change problems, and provides further evidence that the usage of such solvers is a promising and interesting direction for devising systems in the area of belief revision. We envisage the study of further belief revision operators, such as Dalal s operator [Dalal, 1988], in a parameterized setting. For other operators, the results might be very different as the computational complexity is heavily influenced by the choice of the operator (cf. [Creignou et al., 2013]). Furthermore, we want to investigate to what extend the shared variables are key towards tractability for other belief change formalisms, like belief merging, contraction, or update. [Alchourr on et al., 1985] Carlos E. Alchourr on, Peter G ardenfors, and David Makinson. On the logic of theory change: Partial meet contraction and revision functions. J. Symb. Log., 50:510 530, 1985. [Bodlaender, 1993] Hans L. Bodlaender. A tourist guide through treewidth. Acta Cybern., 11(1-2):1 21, 1993. [Creignou et al., 2013] Nadia Creignou, Reinhard Pichler, and Stefan Woltran. Do hard SAT-related reasoning tasks become easier in the Krom fragment? In Proc. IJCAI 2013, pages 824 831. AAAI Press, 2013. [Dalal, 1988] Mukesh Dalal. Investigations into a theory of knowledge base revision. In Proc. AAAI 1988, pages 475 479, 1988. [de Haan and Szeider, 2014a] Ronald de Haan and Stefan Szeider. Compendium of parameterized problems at higher levels of the polynomial hierarchy. Electronic Colloquium on Computational Complexity (ECCC), 21:143, 2014. [de Haan and Szeider, 2014b] Ronald de Haan and Stefan Szeider. Fixed-parameter tractable reductions to SAT. In Proc. SAT 2014, volume 8561 of LNCS, pages 85 102. Springer, 2014. [Delgrande et al., 2007] James P. Delgrande, Daphne H. Liu, Torsten Schaub, and Sven Thiele. COBA 2.0: A consistency-based belief change system. In Proc. ECSQARU 2007, volume 4724 of LNCS, pages 78 90. Springer, 2007. [Downey and Fellows, 1995] Rodney G. Downey and Michael R. Fellows. Fixed-parameter tractability and completeness II: on completeness for W[1]. Theor. Comput. Sci., 141(1&2):109 131, 1995. [Downey and Fellows, 1999] Rodney G. Downey and Michael R. Fellows. Parameterized Complexity. Springer, 1999. [Dvoˇr ak et al., 2012] Wolfgang Dvoˇr ak, Reinhard Pichler, and Stefan Woltran. Towards fixed-parameter tractable algorithms for abstract argumentation. Artif. Intell., 186:1 37, 2012. [Dvoˇr ak et al., 2014] Wolfgang Dvoˇr ak, Matti J arvisalo, Johannes P. Wallner, and Stefan Woltran. Complexitysensitive decision procedures for abstract argumentation. Artif. Intell., 206:53 78, 2014. [Eiter and Gottlob, 1992] Thomas Eiter and Georg Gottlob. On the complexity of propositional knowledge base revision, updates, and counterfactuals. Artif. Intell., 57(23):227 270, 1992. [Fellows et al., 2012] Michael R. Fellows, Andreas Pfandler, Frances A. Rosamond, and Stefan R ummele. The parameterized complexity of abduction. In Proc. AAAI 2012, pages 743 749. AAAI Press, 2012. [Gaspers and Szeider, 2012] Serge Gaspers and Stefan Szeider. Backdoors to satisfaction. In The Multivariate Algorithmic Revolution and Beyond - Essays Dedicated to Michael R. Fellows on the Occasion of His 60th Birthday, volume 7370 of LNCS, pages 287 317. Springer, 2012. [Gottlob and Szeider, 2008] Georg Gottlob and Stefan Szeider. Fixed-parameter algorithms for artificial intelligence, constraint satisfaction and database problems. Comput. J., 51(3):303 325, 2008. [Gottlob et al., 2010] Georg Gottlob, Reinhard Pichler, and Fang Wei. Bounded treewidth as a key to tractability of knowledge representation and reasoning. Artif. Intell., 174(1):105 132, 2010. [Kadin, 1989] Jim Kadin. P (NP[O(logn)]) and sparse turingcomplete sets for NP. J. Comput. Syst. Sci., 39(3):282 298, 1989. [Katsuno and Mendelzon, 1991] Hirofumi Katsuno and Alberto O. Mendelzon. Propositional knowledge base revision and minimal change. Artif. Intell., 52:263 294, 1991. [Lackner and Pfandler, 2012] Martin Lackner and Andreas Pfandler. Fixed-parameter algorithms for finding minimal models. In Proc. KR 2012, pages 85 95. AAAI Press, 2012. [Liberatore and Schaerf, 2001] Paolo Liberatore and Marco Schaerf. Belief revision and update: Complexity of model checking. J. Comput. Syst. Sci., 62(1):43 72, 2001. [Peppas, 2008] Pavlos Peppas. Belief revision. In Handbook of Knowledge Representation, pages 317 359. Elsevier, 2008. [Pichler et al., 2009] Reinhard Pichler, Stefan R ummele, and Stefan Woltran. Belief revision with bounded treewidth. In Proc. LPNMR 2009, volume 5753 of LNCS, pages 250 263. Springer, 2009. [Roussel and Manquinho, 2009] Olivier Roussel and Vasco M. Manquinho. Pseudo-Boolean and cardinality constraints. In Handbook of Satisfiability, volume 185 of FAIA, pages 695 733. IOS Press, 2009. [Satoh, 1988] Ken Satoh. Nonmonotonic reasoning by minimal belief revision. In Proc. FGCS 1988, pages 455 462, 1988.